2023-06-23T18:33:36.058 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T18:33:36.060 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894 --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} --name rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/orig.config.yaml 2023-06-23T18:33:36.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T18:33:36.200 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894 branch: wip-rishabh-improvements-authmon description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} email: null first_in_suite: false job_id: '7313894' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-improvements-authmon ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-improvements-authmon sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-improvements-authmon suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPatyLVMjRsvi4ZOxM3cIu9GOmIfHEQpPSeyWPSio10NScSPoHcvBLS1RO/+tC7b1Di2ugncKIRfR7S9CzlZyIc= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSHSUYPJIubE2l3G3kyqCtHh49GXNywM8jRQqFQqkyZyd0zVdnKRFrgE9K/q0igKMwJYWSov4Mw0b7clTdlyjQ= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvoiJA5wTwxX7NHZ0F12F08/oGbPbEOm7EAOC6iyufkPO/FA9RVGUb/WluPfvCV+PZl07q0p41n4oVJC79LIdw= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG9x/7esvpDkOFFay+qKOPnOe9ucG7mskpW06HS/N5Mo/KffmVHugNmDMYxP2mhvdM3rX6WNVDTpDupMnTr+qw= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2KihXn35fSYKsF+1vyXgVxT/66bHjHwL5aChBkYAUeBX9A9ctnKD9ly24F073XN8AxUghHJ4ho2ezv6Bjz2iU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - pexec: clients: - cd $TESTDIR - wget http://download.ceph.com/qa/mdtest-1.9.3.tgz - mkdir mdtest-1.9.3 - cd mdtest-1.9.3 - tar xvfz $TESTDIR/mdtest-1.9.3.tgz - rm $TESTDIR/mdtest-1.9.3.tgz - MPI_CC=mpicc make - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R - pexec: clients: - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/mdtest-1.9.3 - rm -rf $TESTDIR/._mdtest-1.9.3 teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-23_17:37:30 tube: smithi user: rishabh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-23T18:33:36.201 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa; will attempt to use it 2023-06-23T18:33:36.202 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa/tasks 2023-06-23T18:33:36.202 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-23T18:33:36.205 INFO:teuthology.task.internal:Checking packages... 2023-06-23T18:33:36.233 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8627af3e0adcb765a3c249fcc209cba9f4873e1b' 2023-06-23T18:33:36.233 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-23T18:33:36.234 INFO:teuthology.packaging:ref: None 2023-06-23T18:33:36.234 INFO:teuthology.packaging:tag: None 2023-06-23T18:33:36.234 INFO:teuthology.packaging:branch: wip-rishabh-improvements-authmon 2023-06-23T18:33:36.234 INFO:teuthology.packaging:sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:33:36.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-improvements-authmon 2023-06-23T18:33:36.451 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:33:36.452 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-23T18:33:36.460 INFO:teuthology.task.internal:no buildpackages task found 2023-06-23T18:33:36.460 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-23T18:33:36.470 INFO:teuthology.task.internal:Saving configuration 2023-06-23T18:33:36.486 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-23T18:33:36.497 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:33:36.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.543418', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC4bLsCOT3dR4KdY4gZBJ/0elS6zKf7mWbb3vTsjiQRk'} 2023-06-23T18:33:36.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.541155', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHxUtKcZgsyh8/npxTGXVn0GSEhh0e92qja+wj6/19Tu'} 2023-06-23T18:33:36.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.542273', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCi3Rm8mUn8vS49ngmG/QHAxOv2i978xTeR9iqD+9Ze'} 2023-06-23T18:33:36.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.537013', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEPmPK4E90okTHBuqSnB1ZMJ+DRUwoemQFPV0T1U9WyW'} 2023-06-23T18:33:36.639 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.539364', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF3wZ/Psxg4wd9JN5TGCdWD5Hqa/lCY+LEsgX9ul8i/r'} 2023-06-23T18:33:36.639 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-23T18:33:36.647 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-06-23T18:33:36.647 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-06-23T18:33:36.647 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['client.0'] 2023-06-23T18:33:36.648 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['client.1'] 2023-06-23T18:33:36.648 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['client.2'] 2023-06-23T18:33:36.648 INFO:teuthology.run_tasks:Running task console_log... 2023-06-23T18:33:36.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f780e332ee0>, signals=[15]) 2023-06-23T18:33:36.836 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-23T18:33:36.844 INFO:teuthology.task.internal:Opening connections... 2023-06-23T18:33:36.844 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:33:36.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:33:36.929 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:33:36.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:33:36.999 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:33:37.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:33:37.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2023-06-23T18:33:37.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:33:37.153 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T18:33:37.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:33:37.226 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-23T18:33:37.234 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-06-23T18:33:37.240 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-06-23T18:33:37.240 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-06-23T18:33:37.293 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="22.04" 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=jammy 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2023-06-23T18:33:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2023-06-23T18:33:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T18:33:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T18:33:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T18:33:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T18:33:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=jammy 2023-06-23T18:33:37.296 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-06-23T18:33:37.317 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-06-23T18:33:37.322 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-06-23T18:33:37.323 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-06-23T18:33:37.368 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T18:33:37.368 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T18:33:37.369 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T18:33:37.370 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T18:33:37.370 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T18:33:37.370 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2023-06-23T18:33:37.370 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-06-23T18:33:37.401 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-06-23T18:33:37.408 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-06-23T18:33:37.408 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-06-23T18:33:37.453 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-06-23T18:33:37.454 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-06-23T18:33:37.455 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T18:33:37.455 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T18:33:37.455 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T18:33:37.455 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T18:33:37.455 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-06-23T18:33:37.455 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-23T18:33:37.475 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-06-23T18:33:37.481 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-06-23T18:33:37.481 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-06-23T18:33:37.528 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T18:33:37.528 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-06-23T18:33:37.529 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T18:33:37.530 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T18:33:37.530 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T18:33:37.530 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T18:33:37.530 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2023-06-23T18:33:37.530 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-06-23T18:33:37.559 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-06-23T18:33:37.565 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-06-23T18:33:37.565 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-23T18:33:37.610 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-06-23T18:33:37.611 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-06-23T18:33:37.612 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T18:33:37.612 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T18:33:37.612 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T18:33:37.612 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T18:33:37.612 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2023-06-23T18:33:37.612 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-23T18:33:37.634 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-23T18:33:37.647 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-23T18:33:37.654 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-23T18:33:37.655 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:33:37.657 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:33:37.659 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:33:37.662 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:33:37.664 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:33:37.669 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-23T18:33:37.674 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-23T18:33:37.675 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:33:37.706 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:33:37.708 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:33:37.710 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:33:37.712 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:33:37.732 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-23T18:33:37.871 INFO:teuthology.run_tasks:Running task kernel... 2023-06-23T18:33:37.891 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-23T18:33:37.892 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-23T18:33:37.892 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:33:37.893 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:33:37.894 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:33:37.894 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:33:37.895 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:33:37.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:33:37.899 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-06-23T18:33:37.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:33:37.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:33:37.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:33:37.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:33:37.902 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-06-23T18:33:37.903 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-06-23T18:33:37.903 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-06-23T18:33:37.904 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2023-06-23T18:33:37.945 INFO:teuthology.orchestra.run.smithi118.stdout:5.15.0-56-generic 2023-06-23T18:33:37.945 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.15.0-56-generic 2023-06-23T18:33:37.945 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get clean 2023-06-23T18:33:37.948 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-56-generic 2023-06-23T18:33:37.948 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.15.0-56-generic 2023-06-23T18:33:37.948 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2023-06-23T18:33:37.950 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2023-06-23T18:33:37.950 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2023-06-23T18:33:37.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-06-23T18:33:37.951 INFO:teuthology.orchestra.run.smithi192.stdout:5.15.0-56-generic 2023-06-23T18:33:37.952 INFO:teuthology.orchestra.run.smithi038.stdout:5.15.0-56-generic 2023-06-23T18:33:37.952 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.15.0-56-generic 2023-06-23T18:33:37.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-06-23T18:33:37.953 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.15.0-56-generic 2023-06-23T18:33:37.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get clean 2023-06-23T18:33:38.071 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2023-06-23T18:33:38.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2023-06-23T18:33:38.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-23T18:33:38.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-06-23T18:33:38.111 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T18:33:38.242 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:33:38.243 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:33:38.251 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:33:38.251 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-23T18:33:38.251 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:33:38.257 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:33:38.275 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-23T18:33:38.315 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-23T18:33:38.334 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-23T18:33:38.343 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:33:38.359 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:33:38.371 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:33:38.383 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:33:38.384 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:33:38.425 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-23T18:33:38.437 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-23T18:33:38.441 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-23T18:33:38.452 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [501 kB] 2023-06-23T18:33:38.454 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [246 kB] 2023-06-23T18:33:38.477 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [430 kB] 2023-06-23T18:33:38.478 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [246 kB] 2023-06-23T18:33:38.517 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [501 kB] 2023-06-23T18:33:38.519 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [246 kB] 2023-06-23T18:33:38.524 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [129 kB] 2023-06-23T18:33:38.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.3 kB] 2023-06-23T18:33:38.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-23T18:33:38.528 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [415 kB] 2023-06-23T18:33:38.537 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [724 kB] 2023-06-23T18:33:38.540 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [129 kB] 2023-06-23T18:33:38.540 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [501 kB] 2023-06-23T18:33:38.541 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [63.3 kB] 2023-06-23T18:33:38.542 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:38.542 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [740 kB] 2023-06-23T18:33:38.545 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.3 kB] 2023-06-23T18:33:38.546 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-23T18:33:38.546 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [415 kB] 2023-06-23T18:33:38.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [536 kB] 2023-06-23T18:33:38.556 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [63.3 kB] 2023-06-23T18:33:38.557 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [724 kB] 2023-06-23T18:33:38.557 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:38.558 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [129 kB] 2023-06-23T18:33:38.558 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [536 kB] 2023-06-23T18:33:38.559 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [190 kB] 2023-06-23T18:33:38.563 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.3 kB] 2023-06-23T18:33:38.564 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [415 kB] 2023-06-23T18:33:38.564 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.3 kB] 2023-06-23T18:33:38.565 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [418 kB] 2023-06-23T18:33:38.566 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [740 kB] 2023-06-23T18:33:38.573 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-23T18:33:38.573 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [63.8 kB] 2023-06-23T18:33:38.574 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-23T18:33:38.574 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [63.3 kB] 2023-06-23T18:33:38.575 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:38.575 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:38.600 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [536 kB] 2023-06-23T18:33:38.604 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [740 kB] 2023-06-23T18:33:38.609 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [628 kB] 2023-06-23T18:33:38.613 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [131 kB] 2023-06-23T18:33:38.620 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [430 kB] 2023-06-23T18:33:38.628 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [190 kB] 2023-06-23T18:33:38.629 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.3 kB] 2023-06-23T18:33:38.629 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-23T18:33:38.630 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [418 kB] 2023-06-23T18:33:38.636 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [131 kB] 2023-06-23T18:33:38.640 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [63.8 kB] 2023-06-23T18:33:38.641 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:38.642 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [131 kB] 2023-06-23T18:33:38.670 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-23T18:33:38.671 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-23T18:33:38.674 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-23T18:33:38.674 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-23T18:33:38.675 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [628 kB] 2023-06-23T18:33:38.687 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-23T18:33:38.688 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-23T18:33:38.690 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-23T18:33:38.691 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-23T18:33:38.719 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-23T18:33:38.720 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-23T18:33:38.723 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-23T18:33:38.724 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-23T18:33:38.724 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [932 kB] 2023-06-23T18:33:38.746 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [199 kB] 2023-06-23T18:33:38.750 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.5 kB] 2023-06-23T18:33:38.751 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-23T18:33:38.751 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-23T18:33:38.751 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-23T18:33:38.752 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-23T18:33:38.752 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-23T18:33:38.753 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-23T18:33:38.778 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-23T18:33:38.788 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-23T18:33:38.788 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-23T18:33:38.788 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [22.2 kB] 2023-06-23T18:33:38.789 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-23T18:33:38.792 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [246 kB] 2023-06-23T18:33:38.794 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-23T18:33:38.807 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [932 kB] 2023-06-23T18:33:38.811 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [12.7 kB] 2023-06-23T18:33:38.821 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-23T18:33:38.827 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [552 B] 2023-06-23T18:33:38.830 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [199 kB] 2023-06-23T18:33:38.835 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.5 kB] 2023-06-23T18:33:38.836 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-23T18:33:38.837 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-23T18:33:38.837 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-23T18:33:38.838 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-23T18:33:38.838 INFO:teuthology.orchestra.run.smithi038.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-23T18:33:38.839 INFO:teuthology.orchestra.run.smithi038.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-23T18:33:38.839 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [246 kB] 2023-06-23T18:33:38.875 INFO:teuthology.orchestra.run.smithi038.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-23T18:33:38.876 INFO:teuthology.orchestra.run.smithi038.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-23T18:33:38.876 INFO:teuthology.orchestra.run.smithi038.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [12.7 kB] 2023-06-23T18:33:38.897 INFO:teuthology.orchestra.run.smithi038.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [22.2 kB] 2023-06-23T18:33:38.910 INFO:teuthology.orchestra.run.smithi038.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-23T18:33:38.916 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [430 kB] 2023-06-23T18:33:38.917 INFO:teuthology.orchestra.run.smithi038.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [552 B] 2023-06-23T18:33:38.927 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [430 kB] 2023-06-23T18:33:38.933 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [430 kB] 2023-06-23T18:33:39.040 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [501 kB] 2023-06-23T18:33:39.069 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [501 kB] 2023-06-23T18:33:39.087 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [724 kB] 2023-06-23T18:33:39.097 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [724 kB] 2023-06-23T18:33:39.104 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [724 kB] 2023-06-23T18:33:39.159 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [129 kB] 2023-06-23T18:33:39.184 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.3 kB] 2023-06-23T18:33:39.186 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-23T18:33:39.188 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [129 kB] 2023-06-23T18:33:39.191 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [415 kB] 2023-06-23T18:33:39.192 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [190 kB] 2023-06-23T18:33:39.203 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [190 kB] 2023-06-23T18:33:39.208 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.3 kB] 2023-06-23T18:33:39.209 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [418 kB] 2023-06-23T18:33:39.210 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [190 kB] 2023-06-23T18:33:39.213 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.3 kB] 2023-06-23T18:33:39.215 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [415 kB] 2023-06-23T18:33:39.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.3 kB] 2023-06-23T18:33:39.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-23T18:33:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [418 kB] 2023-06-23T18:33:39.237 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-23T18:33:39.240 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [63.8 kB] 2023-06-23T18:33:39.244 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.3 kB] 2023-06-23T18:33:39.244 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [63.3 kB] 2023-06-23T18:33:39.245 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:39.246 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [418 kB] 2023-06-23T18:33:39.246 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:39.246 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [740 kB] 2023-06-23T18:33:39.252 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-23T18:33:39.253 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [63.8 kB] 2023-06-23T18:33:39.255 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:39.257 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [63.8 kB] 2023-06-23T18:33:39.260 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-23T18:33:39.261 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:39.262 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [63.3 kB] 2023-06-23T18:33:39.268 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-23T18:33:39.268 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [740 kB] 2023-06-23T18:33:39.299 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [536 kB] 2023-06-23T18:33:39.327 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [536 kB] 2023-06-23T18:33:39.409 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [628 kB] 2023-06-23T18:33:39.419 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [932 kB] 2023-06-23T18:33:39.424 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [628 kB] 2023-06-23T18:33:39.489 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [131 kB] 2023-06-23T18:33:39.518 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [131 kB] 2023-06-23T18:33:39.858 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-23T18:33:39.864 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-23T18:33:39.879 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-23T18:33:39.881 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-23T18:33:39.887 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-23T18:33:39.893 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-23T18:33:39.907 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-23T18:33:39.909 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-23T18:33:39.976 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [932 kB] 2023-06-23T18:33:39.988 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [932 kB] 2023-06-23T18:33:40.032 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [628 kB] 2023-06-23T18:33:40.071 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [199 kB] 2023-06-23T18:33:40.083 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.5 kB] 2023-06-23T18:33:40.084 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-23T18:33:40.085 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [199 kB] 2023-06-23T18:33:40.086 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-23T18:33:40.087 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-23T18:33:40.087 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-23T18:33:40.088 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-23T18:33:40.089 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-23T18:33:40.097 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [199 kB] 2023-06-23T18:33:40.103 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.5 kB] 2023-06-23T18:33:40.105 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-23T18:33:40.108 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-23T18:33:40.109 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-23T18:33:40.109 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-23T18:33:40.110 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-23T18:33:40.113 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-23T18:33:40.115 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.5 kB] 2023-06-23T18:33:40.115 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-23T18:33:40.115 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-23T18:33:40.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-23T18:33:40.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-23T18:33:40.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-23T18:33:40.121 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-23T18:33:40.121 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-23T18:33:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-23T18:33:40.127 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-23T18:33:40.279 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-23T18:33:40.280 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-23T18:33:40.291 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-23T18:33:40.362 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [12.7 kB] 2023-06-23T18:33:40.363 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [12.7 kB] 2023-06-23T18:33:40.365 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [22.2 kB] 2023-06-23T18:33:40.367 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [22.2 kB] 2023-06-23T18:33:40.373 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [22.2 kB] 2023-06-23T18:33:40.463 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [12.7 kB] 2023-06-23T18:33:40.480 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-23T18:33:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-23T18:33:40.492 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-23T18:33:40.532 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [552 B] 2023-06-23T18:33:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [552 B] 2023-06-23T18:33:40.543 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [552 B] 2023-06-23T18:33:43.692 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 7,022 kB in 1s (6,137 kB/s) 2023-06-23T18:33:44.139 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 7,022 kB in 2s (4,067 kB/s) 2023-06-23T18:33:44.616 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 7,022 kB in 2s (2,962 kB/s) 2023-06-23T18:33:44.647 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 7,022 kB in 2s (2,931 kB/s) 2023-06-23T18:33:44.768 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 7,022 kB in 2s (2,975 kB/s) 2023-06-23T18:33:44.966 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:33:44.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:33:45.037 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:33:45.215 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2023-06-23T18:33:45.216 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2023-06-23T18:33:45.371 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:33:45.371 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:33:45.372 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:33:45.372 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:33:45.372 INFO:teuthology.orchestra.run.smithi038.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-23T18:33:45.373 INFO:teuthology.orchestra.run.smithi038.stdout: python2.7-minimal 2023-06-23T18:33:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:33:45.373 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2023-06-23T18:33:45.373 INFO:teuthology.orchestra.run.smithi038.stdout: linux-generic linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:45.373 INFO:teuthology.orchestra.run.smithi038.stdout: linux-headers-generic linux-image-5.15.0-75-generic 2023-06-23T18:33:45.374 INFO:teuthology.orchestra.run.smithi038.stdout: linux-modules-5.15.0-75-generic linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2023-06-23T18:33:45.375 INFO:teuthology.orchestra.run.smithi038.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-23T18:33:45.375 INFO:teuthology.orchestra.run.smithi038.stdout:Recommended packages: 2023-06-23T18:33:45.375 INFO:teuthology.orchestra.run.smithi038.stdout: thermald 2023-06-23T18:33:45.383 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:33:45.401 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:33:45.422 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2023-06-23T18:33:45.422 INFO:teuthology.orchestra.run.smithi038.stdout: linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:45.422 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.15.0-75-generic linux-modules-5.15.0-75-generic 2023-06-23T18:33:45.423 INFO:teuthology.orchestra.run.smithi038.stdout: linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:45.423 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages will be upgraded: 2023-06-23T18:33:45.424 INFO:teuthology.orchestra.run.smithi038.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T18:33:45.455 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:33:45.604 INFO:teuthology.orchestra.run.smithi038.stdout:3 upgraded, 5 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:33:45.604 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 114 MB of archives. 2023-06-23T18:33:45.604 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-23T18:33:45.604 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-75-generic amd64 5.15.0-75.82 [23.2 MB] 2023-06-23T18:33:45.623 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T18:33:45.624 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T18:33:45.758 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:33:45.759 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:33:45.759 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:33:45.759 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:33:45.760 INFO:teuthology.orchestra.run.smithi192.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-23T18:33:45.760 INFO:teuthology.orchestra.run.smithi192.stdout: python2.7-minimal 2023-06-23T18:33:45.760 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:33:45.760 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T18:33:45.761 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:45.761 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-generic linux-image-5.15.0-75-generic 2023-06-23T18:33:45.761 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-5.15.0-75-generic linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:45.761 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T18:33:45.762 INFO:teuthology.orchestra.run.smithi192.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-23T18:33:45.762 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-06-23T18:33:45.762 INFO:teuthology.orchestra.run.smithi192.stdout: thermald 2023-06-23T18:33:45.800 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T18:33:45.801 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:45.801 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.15.0-75-generic linux-modules-5.15.0-75-generic 2023-06-23T18:33:45.801 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:45.802 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-06-23T18:33:45.802 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T18:33:45.852 INFO:teuthology.orchestra.run.smithi192.stdout:3 upgraded, 5 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:33:45.852 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 114 MB of archives. 2023-06-23T18:33:45.852 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-23T18:33:45.852 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-75-generic amd64 5.15.0-75.82 [23.2 MB] 2023-06-23T18:33:45.857 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:33:45.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:33:45.875 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:33:45.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:33:45.932 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:33:45.940 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:33:45.958 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:33:45.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:33:46.034 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:33:46.103 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-06-23T18:33:46.104 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-06-23T18:33:46.106 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-23T18:33:46.107 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-23T18:33:46.209 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-06-23T18:33:46.210 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-06-23T18:33:46.239 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:33:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:33:46.239 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:33:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:33:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-23T18:33:46.240 INFO:teuthology.orchestra.run.smithi164.stdout: python2.7-minimal 2023-06-23T18:33:46.240 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:33:46.241 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2023-06-23T18:33:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-generic linux-image-5.15.0-75-generic 2023-06-23T18:33:46.241 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-5.15.0-75-generic linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.242 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2023-06-23T18:33:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-23T18:33:46.242 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2023-06-23T18:33:46.242 INFO:teuthology.orchestra.run.smithi164.stdout: thermald 2023-06-23T18:33:46.253 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:33:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:33:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:33:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:33:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-23T18:33:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2023-06-23T18:33:46.254 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:33:46.255 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-23T18:33:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-75-generic 2023-06-23T18:33:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-75-generic linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.256 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-23T18:33:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-23T18:33:46.256 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-06-23T18:33:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2023-06-23T18:33:46.298 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2023-06-23T18:33:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.298 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.15.0-75-generic linux-modules-5.15.0-75-generic 2023-06-23T18:33:46.299 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-75-generic amd64 5.15.0-75.82 [11.4 MB] 2023-06-23T18:33:46.299 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.300 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2023-06-23T18:33:46.300 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T18:33:46.305 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-23T18:33:46.306 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.306 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-75-generic linux-modules-5.15.0-75-generic 2023-06-23T18:33:46.306 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.307 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-06-23T18:33:46.307 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T18:33:46.348 INFO:teuthology.orchestra.run.smithi164.stdout:3 upgraded, 5 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:33:46.349 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 114 MB of archives. 2023-06-23T18:33:46.349 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-23T18:33:46.349 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-75-generic amd64 5.15.0-75.82 [23.2 MB] 2023-06-23T18:33:46.355 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:33:46.355 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 114 MB of archives. 2023-06-23T18:33:46.356 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-23T18:33:46.356 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-75-generic amd64 5.15.0-75.82 [23.2 MB] 2023-06-23T18:33:46.358 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:33:46.358 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:33:46.358 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:33:46.359 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:33:46.359 INFO:teuthology.orchestra.run.smithi118.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-23T18:33:46.359 INFO:teuthology.orchestra.run.smithi118.stdout: python2.7-minimal 2023-06-23T18:33:46.360 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:33:46.360 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-06-23T18:33:46.360 INFO:teuthology.orchestra.run.smithi118.stdout: linux-generic linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.361 INFO:teuthology.orchestra.run.smithi118.stdout: linux-headers-generic linux-image-5.15.0-75-generic 2023-06-23T18:33:46.361 INFO:teuthology.orchestra.run.smithi118.stdout: linux-modules-5.15.0-75-generic linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.361 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-06-23T18:33:46.362 INFO:teuthology.orchestra.run.smithi118.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-23T18:33:46.362 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2023-06-23T18:33:46.362 INFO:teuthology.orchestra.run.smithi118.stdout: thermald 2023-06-23T18:33:46.404 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-75-generic amd64 5.15.0-75.82 [64.2 MB] 2023-06-23T18:33:46.409 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-06-23T18:33:46.409 INFO:teuthology.orchestra.run.smithi118.stdout: linux-headers-5.15.0-75 linux-headers-5.15.0-75-generic 2023-06-23T18:33:46.409 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.15.0-75-generic linux-modules-5.15.0-75-generic 2023-06-23T18:33:46.410 INFO:teuthology.orchestra.run.smithi118.stdout: linux-modules-extra-5.15.0-75-generic 2023-06-23T18:33:46.410 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2023-06-23T18:33:46.411 INFO:teuthology.orchestra.run.smithi118.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T18:33:46.589 INFO:teuthology.orchestra.run.smithi118.stdout:3 upgraded, 5 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:33:46.589 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 114 MB of archives. 2023-06-23T18:33:46.589 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-23T18:33:46.589 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-75-generic amd64 5.15.0-75.82 [23.2 MB] 2023-06-23T18:33:46.751 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-75-generic amd64 5.15.0-75.82 [11.4 MB] 2023-06-23T18:33:46.770 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-75-generic amd64 5.15.0-75.82 [11.4 MB] 2023-06-23T18:33:46.840 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-75-generic amd64 5.15.0-75.82 [64.2 MB] 2023-06-23T18:33:46.869 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-75-generic amd64 5.15.0-75.82 [64.2 MB] 2023-06-23T18:33:47.029 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-75-generic amd64 5.15.0-75.82 [11.4 MB] 2023-06-23T18:33:47.229 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.75.73 [1,700 B] 2023-06-23T18:33:47.230 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.75.73 [2,510 B] 2023-06-23T18:33:47.230 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75 all 5.15.0-75.82 [12.3 MB] 2023-06-23T18:33:47.355 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75-generic amd64 5.15.0-75.82 [2,904 kB] 2023-06-23T18:33:47.378 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.75.73 [2,358 B] 2023-06-23T18:33:47.388 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-75-generic amd64 5.15.0-75.82 [64.2 MB] 2023-06-23T18:33:47.621 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.75.73 [1,700 B] 2023-06-23T18:33:47.621 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.75.73 [2,510 B] 2023-06-23T18:33:47.622 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75 all 5.15.0-75.82 [12.3 MB] 2023-06-23T18:33:47.644 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.75.73 [1,700 B] 2023-06-23T18:33:47.645 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.75.73 [2,510 B] 2023-06-23T18:33:47.645 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75 all 5.15.0-75.82 [12.3 MB] 2023-06-23T18:33:47.739 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75-generic amd64 5.15.0-75.82 [2,904 kB] 2023-06-23T18:33:47.760 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.75.73 [2,358 B] 2023-06-23T18:33:47.763 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75-generic amd64 5.15.0-75.82 [2,904 kB] 2023-06-23T18:33:47.786 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.75.73 [2,358 B] 2023-06-23T18:33:47.858 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 114 MB in 2s (69.0 MB/s) 2023-06-23T18:33:48.055 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-5.15.0-75-generic. 2023-06-23T18:33:48.096 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-75-generic amd64 5.15.0-75.82 [11.4 MB] 2023-06-23T18:33:48.143 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 114 MB in 1s (78.5 MB/s) 2023-06-23T18:33:48.159 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 114 MB in 1s (77.5 MB/s) 2023-06-23T18:33:48.293 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-5.15.0-75-generic. 2023-06-23T18:33:48.343 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-75-generic. 2023-06-23T18:33:48.444 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-75-generic amd64 5.15.0-75.82 [64.2 MB] 2023-06-23T18:33:49.619 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.75.73 [1,700 B] 2023-06-23T18:33:49.619 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.75.73 [2,510 B] 2023-06-23T18:33:49.619 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75 all 5.15.0-75.82 [12.3 MB] 2023-06-23T18:33:50.072 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-23T18:33:50.076 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../0-linux-modules-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:50.231 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:50.340 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-23T18:33:50.345 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../0-linux-modules-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:50.357 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75-generic amd64 5.15.0-75.82 [2,904 kB] 2023-06-23T18:33:50.433 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-23T18:33:50.438 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:50.473 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:50.481 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.75.73 [2,358 B] 2023-06-23T18:33:50.524 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:50.714 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.75.73 [1,700 B] 2023-06-23T18:33:50.714 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.75.73 [2,510 B] 2023-06-23T18:33:50.715 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75 all 5.15.0-75.82 [12.3 MB] 2023-06-23T18:33:50.925 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 114 MB in 5s (22.6 MB/s) 2023-06-23T18:33:51.082 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-modules-5.15.0-75-generic. 2023-06-23T18:33:51.191 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-75-generic amd64 5.15.0-75.82 [2,904 kB] 2023-06-23T18:33:51.246 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.75.73 [2,358 B] 2023-06-23T18:33:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 114 MB in 5s (23.6 MB/s) 2023-06-23T18:33:51.788 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-modules-5.15.0-75-generic. 2023-06-23T18:33:52.453 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-image-5.15.0-75-generic. 2023-06-23T18:33:52.475 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../1-linux-image-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:52.560 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:52.742 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-75-generic. 2023-06-23T18:33:52.763 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:52.845 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:53.023 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-75-generic. 2023-06-23T18:33:53.043 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:53.081 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:53.122 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-23T18:33:53.126 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../0-linux-modules-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:53.371 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-75-generic. 2023-06-23T18:33:53.392 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:53.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:53.449 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-image-5.15.0-75-generic. 2023-06-23T18:33:53.470 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../1-linux-image-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:53.547 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:53.892 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-23T18:33:53.896 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../0-linux-modules-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:54.068 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-75-generic. 2023-06-23T18:33:54.089 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:54.134 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:54.152 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:55.897 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-image-5.15.0-75-generic. 2023-06-23T18:33:55.919 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../1-linux-image-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:56.002 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:56.509 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-image-5.15.0-75-generic. 2023-06-23T18:33:56.517 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-75-generic. 2023-06-23T18:33:56.531 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../1-linux-image-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:56.538 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:56.597 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:56.618 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:33:57.037 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-75-generic. 2023-06-23T18:33:57.058 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:33:57.096 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:00.087 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../3-linux-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:00.189 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:00.393 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:00.479 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:00.508 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:00.600 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:00.834 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../3-linux-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:00.850 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:00.903 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.15.0-75. 2023-06-23T18:34:00.926 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../5-linux-headers-5.15.0-75_5.15.0-75.82_all.deb ... 2023-06-23T18:34:00.970 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:00.970 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:00.978 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:01.315 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-75. 2023-06-23T18:34:01.320 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:01.337 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-75_5.15.0-75.82_all.deb ... 2023-06-23T18:34:01.390 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:01.473 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:01.776 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.15.0-75. 2023-06-23T18:34:01.787 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../5-linux-headers-5.15.0-75_5.15.0-75.82_all.deb ... 2023-06-23T18:34:01.819 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:03.358 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../3-linux-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:03.468 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:03.823 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../3-linux-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:03.826 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:03.931 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:03.948 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-image-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:04.231 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:04.292 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-headers-5.15.0-75. 2023-06-23T18:34:04.314 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../5-linux-headers-5.15.0-75_5.15.0-75.82_all.deb ... 2023-06-23T18:34:04.350 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:04.360 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:04.655 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-headers-5.15.0-75. 2023-06-23T18:34:04.678 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../5-linux-headers-5.15.0-75_5.15.0-75.82_all.deb ... 2023-06-23T18:34:04.721 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:06.889 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-75-generic. 2023-06-23T18:34:06.927 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:34:06.964 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.15.0-75-generic. 2023-06-23T18:34:06.964 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:07.000 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../6-linux-headers-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:34:07.038 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:07.772 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.15.0-75-generic. 2023-06-23T18:34:07.809 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../6-linux-headers-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:34:07.847 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:09.720 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:09.860 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:10.193 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:10.201 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:10.307 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:10.327 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:10.408 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-generic (5.15.0.75.73) ... 2023-06-23T18:34:10.500 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package linux-headers-5.15.0-75-generic. 2023-06-23T18:34:10.506 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-headers-5.15.0-75-generic. 2023-06-23T18:34:10.527 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:10.537 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../6-linux-headers-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:34:10.544 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../6-linux-headers-5.15.0-75-generic_5.15.0-75.82_amd64.deb ... 2023-06-23T18:34:10.575 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:10.581 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:10.677 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:10.798 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:10.941 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.75.73) ... 2023-06-23T18:34:11.060 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:11.124 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:11.282 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:11.649 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:11.795 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:11.861 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:11.861 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:11.862 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:11.862 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:11.921 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-generic (5.15.0.75.73) ... 2023-06-23T18:34:12.032 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:12.416 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:12.416 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:12.417 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:12.417 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:12.581 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:13.189 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:13.304 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:13.424 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:13.431 INFO:teuthology.orchestra.run.smithi164.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:13.431 INFO:teuthology.orchestra.run.smithi164.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:13.431 INFO:teuthology.orchestra.run.smithi164.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:13.432 INFO:teuthology.orchestra.run.smithi164.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:13.486 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.75.73_amd64.deb ... 2023-06-23T18:34:13.611 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking linux-headers-generic (5.15.0.75.73) over (5.15.0.56.54) ... 2023-06-23T18:34:14.029 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:14.031 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.097 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.151 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.277 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-generic (5.15.0.75.73) ... 2023-06-23T18:34:14.403 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-5.15.0-75 (5.15.0-75.82) ... 2023-06-23T18:34:14.405 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.499 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.651 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-headers-generic (5.15.0.75.73) ... 2023-06-23T18:34:14.778 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:14.801 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-generic (5.15.0.75.73) ... 2023-06-23T18:34:14.926 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-generic (5.15.0.75.73) ... 2023-06-23T18:34:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:15.127 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T18:34:15.127 INFO:teuthology.orchestra.run.smithi192.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:15.466 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.75.73) ... 2023-06-23T18:34:15.539 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:15.584 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.75.73) ... 2023-06-23T18:34:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:15.737 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T18:34:15.738 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:15.752 INFO:teuthology.orchestra.run.smithi118.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:15.753 INFO:teuthology.orchestra.run.smithi118.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:15.753 INFO:teuthology.orchestra.run.smithi118.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:15.753 INFO:teuthology.orchestra.run.smithi118.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:15.912 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:16.149 INFO:teuthology.orchestra.run.smithi038.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:16.149 INFO:teuthology.orchestra.run.smithi038.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:16.149 INFO:teuthology.orchestra.run.smithi038.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:16.150 INFO:teuthology.orchestra.run.smithi038.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:16.331 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-modules-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:16.974 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-generic (5.15.0.75.73) ... 2023-06-23T18:34:17.083 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-generic (5.15.0.75.73) ... 2023-06-23T18:34:17.207 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:17.266 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T18:34:17.266 INFO:teuthology.orchestra.run.smithi164.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:17.287 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:17.791 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-modules-extra-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:18.672 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-generic (5.15.0.75.73) ... 2023-06-23T18:34:18.789 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-generic (5.15.0.75.73) ... 2023-06-23T18:34:18.891 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:18.952 INFO:teuthology.orchestra.run.smithi118.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T18:34:18.952 INFO:teuthology.orchestra.run.smithi118.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:19.200 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-image-generic (5.15.0.75.73) ... 2023-06-23T18:34:19.976 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up linux-generic (5.15.0.75.73) ... 2023-06-23T18:34:20.128 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for linux-image-5.15.0-75-generic (5.15.0-75.82) ... 2023-06-23T18:34:20.195 INFO:teuthology.orchestra.run.smithi038.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T18:34:20.196 INFO:teuthology.orchestra.run.smithi038.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:29.891 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T18:34:29.892 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub' 2023-06-23T18:34:29.909 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:29.933 INFO:teuthology.orchestra.run.smithi192.stdout:Generating grub configuration file ... 2023-06-23T18:34:30.193 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:30.209 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:30.517 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T18:34:30.517 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2023-06-23T18:34:30.528 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:30.534 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:30.540 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:30.561 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2023-06-23T18:34:30.593 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:30.600 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:30.781 INFO:teuthology.orchestra.run.smithi192.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:30.782 INFO:teuthology.orchestra.run.smithi192.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:30.782 INFO:teuthology.orchestra.run.smithi192.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:30.831 INFO:teuthology.orchestra.run.smithi192.stdout:done 2023-06-23T18:34:30.896 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:30.918 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:31.279 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:31.285 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:31.287 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-06-23T18:34:31.312 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-06-23T18:34:31.312 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 20 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-06-23T18:34:31.313 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:31.314 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-06-23T18:34:31.315 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-75-generic 2023-06-23T18:34:31.316 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T18:34:31.316 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T18:34:31.316 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2023-06-23T18:34:31.316 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T18:34:31.316 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-06-23T18:34:31.350 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:31.356 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:31.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T18:34:31.528 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:31.528 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:31.528 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:31.576 INFO:teuthology.orchestra.run.smithi081.stdout:done 2023-06-23T18:34:31.604 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:34:31.614 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:34:31.631 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:34:31.698 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T18:34:31.698 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub' 2023-06-23T18:34:31.726 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:34:31.730 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:31.794 INFO:teuthology.orchestra.run.smithi164.stdout:Generating grub configuration file ... 2023-06-23T18:34:32.050 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-06-23T18:34:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:32.070 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-06-23T18:34:32.071 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:32.071 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:32.071 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-06-23T18:34:32.071 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-75-generic 2023-06-23T18:34:32.071 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T18:34:32.072 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T18:34:32.072 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-23T18:34:32.072 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T18:34:32.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-06-23T18:34:32.169 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:32.207 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:32.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-23T18:34:32.350 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:34:32.350 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:34:32.360 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:34:32.377 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:34:32.628 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:32.634 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:32.710 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:32.716 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:32.780 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 110 kB in 0s (287 kB/s) 2023-06-23T18:34:32.826 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:34:32.843 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:34:32.902 INFO:teuthology.orchestra.run.smithi164.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:32.903 INFO:teuthology.orchestra.run.smithi164.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:32.903 INFO:teuthology.orchestra.run.smithi164.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:32.903 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:34:32.953 INFO:teuthology.orchestra.run.smithi164.stdout:done 2023-06-23T18:34:33.078 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T18:34:33.079 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T18:34:33.213 INFO:teuthology.orchestra.run.smithi118.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T18:34:33.213 INFO:teuthology.orchestra.run.smithi118.stdout:Sourcing file `/etc/default/grub' 2023-06-23T18:34:33.223 INFO:teuthology.orchestra.run.smithi118.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:33.228 INFO:teuthology.orchestra.run.smithi192.stdout:linux-image-generic is already the newest version (5.15.0.75.73). 2023-06-23T18:34:33.229 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:34:33.229 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:34:33.229 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:34:33.229 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:34:33.229 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:34:33.230 INFO:teuthology.orchestra.run.smithi192.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:34:33.230 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:34:33.243 INFO:teuthology.orchestra.run.smithi118.stdout:Generating grub configuration file ... 2023-06-23T18:34:33.267 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 0 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:34:33.268 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-06-23T18:34:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-06-23T18:34:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-06-23T18:34:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-06-23T18:34:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-06-23T18:34:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 20 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-06-23T18:34:33.282 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:33.283 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:33.283 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-06-23T18:34:33.283 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-06-23T18:34:33.326 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.9PVHtm09SA 2023-06-23T18:34:33.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9PVHtm09SA 2023-06-23T18:34:33.384 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.9PVHtm09SA 2023-06-23T18:34:33.429 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2023-06-23T18:34:33.456 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2023-06-23T18:34:33.456 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 20 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:33.458 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:33.458 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2023-06-23T18:34:33.458 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:33.458 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2023-06-23T18:34:33.458 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-75-generic 2023-06-23T18:34:33.459 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T18:34:33.459 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T18:34:33.459 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-06-23T18:34:33.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T18:34:33.459 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2023-06-23T18:34:33.491 INFO:teuthology.orchestra.run.smithi118.stdout:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:33.503 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.9PVHtm09SA is 10KB 2023-06-23T18:34:33.506 INFO:teuthology.orchestra.run.smithi118.stdout:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:33.515 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.9PVHtm09SA 2023-06-23T18:34:33.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:33.573 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:34:33.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T18:34:33.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:33.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2023-06-23T18:34:33.616 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:34:33.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:34:33.641 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-75-generic 2023-06-23T18:34:33.641 DEBUG:teuthology.orchestra.run.smithi192:> sudo update-grub 2023-06-23T18:34:33.693 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:34:33.706 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:34:33.717 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:34:33.734 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:34:33.795 INFO:teuthology.orchestra.run.smithi118.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:33.800 INFO:teuthology.orchestra.run.smithi118.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:33.830 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:34:33.870 INFO:teuthology.orchestra.run.smithi118.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:33.875 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-23T18:34:33.876 INFO:teuthology.orchestra.run.smithi118.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:33.876 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-23T18:34:34.027 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.75.73). 2023-06-23T18:34:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:34:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:34:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:34:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:34:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:34:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:34:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:34:34.047 INFO:teuthology.orchestra.run.smithi118.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:34.047 INFO:teuthology.orchestra.run.smithi118.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:34.047 INFO:teuthology.orchestra.run.smithi118.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:34.064 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:34:34.066 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-06-23T18:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-06-23T18:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-06-23T18:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-06-23T18:34:34.084 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-06-23T18:34:34.091 INFO:teuthology.orchestra.run.smithi118.stdout:done 2023-06-23T18:34:34.127 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.LgpC2cDPg0 2023-06-23T18:34:34.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LgpC2cDPg0 2023-06-23T18:34:34.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.LgpC2cDPg0 2023-06-23T18:34:34.292 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 110 kB in 1s (207 kB/s) 2023-06-23T18:34:34.301 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.LgpC2cDPg0 is 10KB 2023-06-23T18:34:34.313 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.LgpC2cDPg0 2023-06-23T18:34:34.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:34.371 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:34:34.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T18:34:34.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:34.439 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-75-generic 2023-06-23T18:34:34.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2023-06-23T18:34:34.554 DEBUG:teuthology.orchestra.run.smithi118:> dpkg -s linux-image-generic 2023-06-23T18:34:34.573 INFO:teuthology.orchestra.run.smithi118.stdout:Package: linux-image-generic 2023-06-23T18:34:34.573 INFO:teuthology.orchestra.run.smithi118.stdout:Status: install ok installed 2023-06-23T18:34:34.573 INFO:teuthology.orchestra.run.smithi118.stdout:Priority: optional 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Section: kernel 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Installed-Size: 20 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: amd64 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Source: linux-meta 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:34.574 INFO:teuthology.orchestra.run.smithi118.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:34.575 INFO:teuthology.orchestra.run.smithi118.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:34.575 INFO:teuthology.orchestra.run.smithi118.stdout:Recommends: thermald 2023-06-23T18:34:34.575 INFO:teuthology.orchestra.run.smithi118.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:34.575 INFO:teuthology.orchestra.run.smithi118.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:34.575 INFO:teuthology.orchestra.run.smithi118.stdout: available. 2023-06-23T18:34:34.575 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-75-generic 2023-06-23T18:34:34.575 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T18:34:34.576 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T18:34:34.576 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-06-23T18:34:34.576 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T18:34:34.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get clean 2023-06-23T18:34:34.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-06-23T18:34:34.766 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub' 2023-06-23T18:34:34.767 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:34.769 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-06-23T18:34:34.836 INFO:teuthology.orchestra.run.smithi038.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T18:34:34.836 INFO:teuthology.orchestra.run.smithi038.stdout:Sourcing file `/etc/default/grub' 2023-06-23T18:34:34.865 INFO:teuthology.orchestra.run.smithi038.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:34.882 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:34:34.882 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:34:34.883 INFO:teuthology.orchestra.run.smithi038.stdout:Generating grub configuration file ... 2023-06-23T18:34:34.891 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:34:34.908 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:34:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:35.124 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:34:35.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:34:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:35.179 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:35.191 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:34:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:35.225 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:35.231 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:35.263 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:35.347 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-06-23T18:34:35.348 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-06-23T18:34:35.365 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-06-23T18:34:35.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-06-23T18:34:35.482 INFO:teuthology.orchestra.run.smithi164.stdout:linux-image-generic is already the newest version (5.15.0.75.73). 2023-06-23T18:34:35.482 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:34:35.483 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:34:35.483 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:34:35.483 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:34:35.484 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:34:35.484 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:34:35.485 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:34:35.518 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 0 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:34:35.519 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2023-06-23T18:34:35.582 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2023-06-23T18:34:35.582 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2023-06-23T18:34:35.582 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2023-06-23T18:34:35.582 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 20 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:35.583 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:35.584 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2023-06-23T18:34:35.584 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:35.584 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:35.584 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2023-06-23T18:34:35.585 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2023-06-23T18:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2023-06-23T18:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-06-23T18:34:35.631 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.HH3Xg9Cl6y 2023-06-23T18:34:35.632 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HH3Xg9Cl6y 2023-06-23T18:34:35.638 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:35.644 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:35.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.HH3Xg9Cl6y 2023-06-23T18:34:35.713 INFO:teuthology.orchestra.run.smithi038.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:35.719 INFO:teuthology.orchestra.run.smithi038.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:35.799 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:35.803 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.HH3Xg9Cl6y is 10KB 2023-06-23T18:34:35.805 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:35.815 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.HH3Xg9Cl6y 2023-06-23T18:34:35.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:35.874 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:34:35.874 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T18:34:35.874 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:35.921 INFO:teuthology.orchestra.run.smithi038.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:35.921 INFO:teuthology.orchestra.run.smithi038.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:35.922 INFO:teuthology.orchestra.run.smithi038.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:35.962 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-75-generic 2023-06-23T18:34:35.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo update-grub 2023-06-23T18:34:35.968 INFO:teuthology.orchestra.run.smithi038.stdout:done 2023-06-23T18:34:36.086 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:36.089 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:34:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:36.106 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:34:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:36.166 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:34:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-06-23T18:34:36.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-06-23T18:34:36.340 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-06-23T18:34:36.341 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-06-23T18:34:36.464 DEBUG:teuthology.orchestra.run.smithi038:> dpkg -s linux-image-generic 2023-06-23T18:34:36.488 INFO:teuthology.orchestra.run.smithi038.stdout:Package: linux-image-generic 2023-06-23T18:34:36.488 INFO:teuthology.orchestra.run.smithi038.stdout:Status: install ok installed 2023-06-23T18:34:36.488 INFO:teuthology.orchestra.run.smithi038.stdout:Priority: optional 2023-06-23T18:34:36.488 INFO:teuthology.orchestra.run.smithi038.stdout:Section: kernel 2023-06-23T18:34:36.488 INFO:teuthology.orchestra.run.smithi038.stdout:Installed-Size: 20 2023-06-23T18:34:36.489 INFO:teuthology.orchestra.run.smithi038.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:36.489 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: amd64 2023-06-23T18:34:36.489 INFO:teuthology.orchestra.run.smithi038.stdout:Source: linux-meta 2023-06-23T18:34:36.489 INFO:teuthology.orchestra.run.smithi038.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:36.489 INFO:teuthology.orchestra.run.smithi038.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:36.490 INFO:teuthology.orchestra.run.smithi038.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:36.490 INFO:teuthology.orchestra.run.smithi038.stdout:Recommends: thermald 2023-06-23T18:34:36.490 INFO:teuthology.orchestra.run.smithi038.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:36.490 INFO:teuthology.orchestra.run.smithi038.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:36.490 INFO:teuthology.orchestra.run.smithi038.stdout: available. 2023-06-23T18:34:36.491 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-75-generic 2023-06-23T18:34:36.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T18:34:36.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T18:34:36.491 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-23T18:34:36.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T18:34:36.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get clean 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout:linux-image-generic is already the newest version (5.15.0.75.73). 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:34:36.493 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:34:36.494 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:34:36.525 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 0 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:34:36.527 DEBUG:teuthology.orchestra.run.smithi118:> dpkg -s linux-image-generic 2023-06-23T18:34:36.543 INFO:teuthology.orchestra.run.smithi118.stdout:Package: linux-image-generic 2023-06-23T18:34:36.543 INFO:teuthology.orchestra.run.smithi118.stdout:Status: install ok installed 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Priority: optional 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Section: kernel 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Installed-Size: 20 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: amd64 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Source: linux-meta 2023-06-23T18:34:36.544 INFO:teuthology.orchestra.run.smithi118.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout:Recommends: thermald 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:36.545 INFO:teuthology.orchestra.run.smithi118.stdout: available. 2023-06-23T18:34:36.546 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-06-23T18:34:36.588 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.NZzrgeT5bh 2023-06-23T18:34:36.589 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NZzrgeT5bh 2023-06-23T18:34:36.645 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.NZzrgeT5bh 2023-06-23T18:34:36.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2023-06-23T18:34:36.766 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.NZzrgeT5bh is 10KB 2023-06-23T18:34:36.778 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.NZzrgeT5bh 2023-06-23T18:34:36.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:36.814 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:34:36.822 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:34:36.836 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:34:36.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T18:34:36.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:36.839 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:34:36.903 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-75-generic 2023-06-23T18:34:36.904 DEBUG:teuthology.orchestra.run.smithi118:> sudo update-grub 2023-06-23T18:34:36.934 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-23T18:34:37.352 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2023-06-23T18:34:37.353 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2023-06-23T18:34:37.393 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 110 kB in 1s (205 kB/s) 2023-06-23T18:34:37.562 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:37.567 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:37.920 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:37.992 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2023-06-23T18:34:37.993 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:37.994 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-06-23T18:34:38.116 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:38.116 INFO:teuthology.orchestra.run.smithi164.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:38.116 INFO:teuthology.orchestra.run.smithi164.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:done 2023-06-23T18:34:38.155 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2023-06-23T18:34:38.181 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:38.187 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:38.231 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:34:38.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T18:34:38.300 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:34:38.466 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:38.471 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:38.473 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2023-06-23T18:34:38.474 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2023-06-23T18:34:38.512 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:38.518 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:38.612 INFO:teuthology.orchestra.run.smithi038.stdout:linux-image-generic is already the newest version (5.15.0.75.73). 2023-06-23T18:34:38.612 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:34:38.613 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:34:38.613 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:34:38.613 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:34:38.613 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:34:38.614 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:34:38.614 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:34:38.649 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 0 newly installed, 0 to remove and 212 not upgraded. 2023-06-23T18:34:38.651 DEBUG:teuthology.orchestra.run.smithi038:> dpkg -s linux-image-generic 2023-06-23T18:34:38.655 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:38.656 INFO:teuthology.orchestra.run.smithi118.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:38.656 INFO:teuthology.orchestra.run.smithi118.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:38.673 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-06-23T18:34:38.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-06-23T18:34:38.707 INFO:teuthology.orchestra.run.smithi038.stdout:Package: linux-image-generic 2023-06-23T18:34:38.707 INFO:teuthology.orchestra.run.smithi038.stdout:Status: install ok installed 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Priority: optional 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Section: kernel 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Installed-Size: 20 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: amd64 2023-06-23T18:34:38.708 INFO:teuthology.orchestra.run.smithi038.stdout:Source: linux-meta 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout:Version: 5.15.0.75.73 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-75), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout:Depends: linux-image-5.15.0-75-generic, linux-modules-extra-5.15.0-75-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout:Recommends: thermald 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout:Description: Generic Linux kernel image 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: This package will always depend on the latest generic kernel image 2023-06-23T18:34:38.709 INFO:teuthology.orchestra.run.smithi038.stdout: available. 2023-06-23T18:34:38.710 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-06-23T18:34:38.752 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.XmAzUrhKmS 2023-06-23T18:34:38.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XmAzUrhKmS 2023-06-23T18:34:38.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.XmAzUrhKmS 2023-06-23T18:34:38.949 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.XmAzUrhKmS is 10KB 2023-06-23T18:34:38.961 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.XmAzUrhKmS 2023-06-23T18:34:38.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:39.024 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:34:39.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T18:34:39.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T18:34:39.125 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-75-generic 2023-06-23T18:34:39.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo update-grub 2023-06-23T18:34:40.318 INFO:teuthology.orchestra.run.smithi038.stderr:Sourcing file `/etc/default/grub' 2023-06-23T18:34:40.319 INFO:teuthology.orchestra.run.smithi038.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T18:34:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2023-06-23T18:34:40.633 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.15.0-75-generic 2023-06-23T18:34:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.15.0-75-generic 2023-06-23T18:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-23T18:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-23T18:34:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-23T18:34:41.041 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-23T18:34:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-23T18:34:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-23T18:34:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-23T18:34:41.189 INFO:teuthology.orchestra.run.smithi038.stderr:done 2023-06-23T18:34:41.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2023-06-23T18:35:05.393 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2023-06-23T18:35:05.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T18:35:05.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:06.319 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-23T18:35:06.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-23T18:35:06.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:08.158 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-23T18:35:08.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-06-23T18:35:08.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:08.718 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-23T18:35:08.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-23T18:35:08.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:11.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-23T18:35:11.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-23T18:35:11.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:23.892 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-23T18:35:24.656 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-06-23T18:35:26.712 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-06-23T18:35:27.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-23T18:35:29.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-23T18:35:53.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T18:35:53.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:54.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-23T18:35:54.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:56.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-06-23T18:35:56.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:57.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-23T18:35:57.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:35:59.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-23T18:35:59.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:36:12.272 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-23T18:36:13.040 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-06-23T18:36:15.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-06-23T18:36:17.908 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-23T18:36:42.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T18:36:42.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:36:42.551 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-23T18:36:43.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-23T18:36:43.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:36:43.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T18:36:43.147 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.15.0-75-generic"... 2023-06-23T18:36:43.147 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-06-23T18:36:43.191 INFO:teuthology.orchestra.run.smithi192.stdout:5.15.0-75-generic 2023-06-23T18:36:43.192 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-75-generic vs 5.15.0-75-generic 2023-06-23T18:36:43.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:36:43.192 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T18:36:43.291 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-06-23T18:36:43.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-23T18:36:43.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-75-generic"... 2023-06-23T18:36:43.851 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-06-23T18:36:43.898 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-75-generic 2023-06-23T18:36:43.898 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-75-generic vs 5.15.0-75-generic 2023-06-23T18:36:43.898 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:36:43.898 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T18:36:44.193 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2023-06-23T18:36:44.193 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T18:36:44.257 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2023-06-23T18:36:44.281 DEBUG:teuthology.parallel:result is None 2023-06-23T18:36:44.900 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-23T18:36:44.900 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T18:36:45.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-06-23T18:36:45.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:36:45.243 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2023-06-23T18:36:45.259 DEBUG:teuthology.parallel:result is None 2023-06-23T18:36:45.503 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-06-23T18:36:46.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-06-23T18:36:46.089 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-75-generic"... 2023-06-23T18:36:46.089 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2023-06-23T18:36:46.137 INFO:teuthology.orchestra.run.smithi164.stdout:5.15.0-75-generic 2023-06-23T18:36:46.137 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-75-generic vs 5.15.0-75-generic 2023-06-23T18:36:46.138 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:36:46.138 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T18:36:47.139 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-06-23T18:36:47.140 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T18:36:47.486 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2023-06-23T18:36:47.502 DEBUG:teuthology.parallel:result is None 2023-06-23T18:36:47.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-23T18:36:47.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:36:48.143 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-06-23T18:36:48.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-23T18:36:48.760 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-75-generic"... 2023-06-23T18:36:48.761 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-06-23T18:36:48.806 INFO:teuthology.orchestra.run.smithi038.stdout:5.15.0-75-generic 2023-06-23T18:36:48.806 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-75-generic vs 5.15.0-75-generic 2023-06-23T18:36:48.807 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:36:48.807 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T18:36:49.808 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-23T18:36:49.808 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T18:36:49.896 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2023-06-23T18:36:49.932 DEBUG:teuthology.parallel:result is None 2023-06-23T18:36:57.225 DEBUG:teuthology.orchestra.remote:timed out 2023-06-23T18:37:27.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-23T18:37:27.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:37:27.463 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-06-23T18:37:28.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-23T18:37:28.062 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-75-generic"... 2023-06-23T18:37:28.062 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-06-23T18:37:28.107 INFO:teuthology.orchestra.run.smithi118.stdout:5.15.0-75-generic 2023-06-23T18:37:28.138 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-75-generic vs 5.15.0-75-generic 2023-06-23T18:37:28.138 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:37:28.139 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T18:37:29.140 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-06-23T18:37:29.140 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T18:37:29.201 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2023-06-23T18:37:29.216 DEBUG:teuthology.parallel:result is None 2023-06-23T18:37:29.217 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-23T18:37:29.224 INFO:teuthology.task.internal:Creating test directory... 2023-06-23T18:37:29.224 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:37:29.227 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:37:29.229 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:37:29.232 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:37:29.234 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:37:29.241 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-23T18:37:29.249 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-23T18:37:29.257 INFO:teuthology.task.internal:Creating archive directory... 2023-06-23T18:37:29.258 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:37:29.275 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:37:29.278 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:37:29.281 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:37:29.284 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:37:29.371 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-23T18:37:29.381 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-23T18:37:29.382 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:37:29.385 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:37:29.387 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:37:29.390 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:37:29.392 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:37:29.400 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.405 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.408 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.409 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.409 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.413 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.416 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.416 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.418 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.425 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:37:29.427 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-23T18:37:29.437 INFO:teuthology.task.internal:Configuring sudo... 2023-06-23T18:37:29.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:37:29.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:37:29.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:37:29.460 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:37:29.465 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:37:29.483 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-23T18:37:29.493 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-23T18:37:29.493 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:37:29.511 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:37:29.518 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:37:29.521 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:37:29.523 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:37:29.535 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:37:29.562 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:37:29.610 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:37:29.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:37:29.667 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:37:29.673 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:37:29.724 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:37:29.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:37:29.789 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:37:29.795 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:37:29.843 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:37:29.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:37:29.915 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:37:29.920 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:37:29.970 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:37:29.970 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:37:30.035 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:37:30.041 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:37:30.087 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:37:30.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:37:30.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2023-06-23T18:37:30.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-06-23T18:37:30.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-06-23T18:37:30.197 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2023-06-23T18:37:30.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-06-23T18:37:30.298 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-23T18:37:30.305 INFO:teuthology.task.internal:Starting timer... 2023-06-23T18:37:30.305 INFO:teuthology.run_tasks:Running task pcp... 2023-06-23T18:37:30.315 INFO:teuthology.run_tasks:Running task selinux... 2023-06-23T18:37:30.323 DEBUG:teuthology.task.selinux:Excluding smithi038: OS 'ubuntu' does not support SELinux 2023-06-23T18:37:30.323 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2023-06-23T18:37:30.323 DEBUG:teuthology.task.selinux:Excluding smithi118: OS 'ubuntu' does not support SELinux 2023-06-23T18:37:30.324 DEBUG:teuthology.task.selinux:Excluding smithi164: OS 'ubuntu' does not support SELinux 2023-06-23T18:37:30.324 DEBUG:teuthology.task.selinux:Excluding smithi192: OS 'ubuntu' does not support SELinux 2023-06-23T18:37:30.324 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-23T18:37:30.325 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-23T18:37:30.325 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-23T18:37:30.325 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-23T18:37:30.333 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-23T18:37:30.339 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-23T18:37:30.470 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-23T18:37:30.488 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-23T18:37:30.490 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi081.front.sepia.ceph.com,smithi118.front.sepia.ceph.com,smithi164.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-23T18:45:15.187 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-06-23T18:45:15.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-23T18:45:15.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:45:15.270 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-06-23T18:45:15.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-23T18:45:15.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:45:15.448 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-06-23T18:45:15.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-23T18:45:15.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:45:15.637 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-06-23T18:45:15.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-06-23T18:45:15.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:45:15.812 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-06-23T18:45:15.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T18:45:15.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:45:15.994 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-23T18:45:16.092 INFO:teuthology.run_tasks:Running task clock... 2023-06-23T18:45:16.102 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-23T18:45:16.103 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:45:16.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:45:16.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:45:16.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:45:16.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:45:16.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:45:16.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:45:16.111 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:45:16.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:45:16.113 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:45:16.134 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-23T18:45:16.134 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Command line: ntpd -gq 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: ---------------------------------------------------- 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: ntp-4 is maintained by Network Time Foundation, 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: corporation. Support and training for ntp-4 are 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: available at https://www.nwtime.org/support 2023-06-23T18:45:16.135 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: ---------------------------------------------------- 2023-06-23T18:45:16.136 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: proto: precision = 0.046 usec (-24) 2023-06-23T18:45:16.136 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: basedate set to 2022-02-04 2023-06-23T18:45:16.136 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: gps base set to 2022-02-06 (week 2196) 2023-06-23T18:45:16.137 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.137 INFO:teuthology.orchestra.run.smithi038.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.137 INFO:teuthology.orchestra.run.smithi038.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.138 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.138 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T18:45:16.138 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T18:45:16.138 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T18:45:16.138 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen normally on 3 ens1f0 172.21.15.38:123 2023-06-23T18:45:16.139 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen normally on 4 lo [::1]:123 2023-06-23T18:45:16.139 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15fc%4]:123 2023-06-23T18:45:16.139 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:16 ntpd[27352]: Listening on routing socket on fd #22 for interface updates 2023-06-23T18:45:16.140 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Command line: ntpd -gq 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: ---------------------------------------------------- 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: ntp-4 is maintained by Network Time Foundation, 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: corporation. Support and training for ntp-4 are 2023-06-23T18:45:16.141 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: available at https://www.nwtime.org/support 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: ---------------------------------------------------- 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: proto: precision = 0.045 usec (-24) 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: basedate set to 2022-02-04 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: gps base set to 2022-02-06 (week 2196) 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-23T18:45:16.142 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Command line: ntpd -gq 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: ---------------------------------------------------- 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: ntp-4 is maintained by Network Time Foundation, 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: corporation. Support and training for ntp-4 are 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: available at https://www.nwtime.org/support 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: ---------------------------------------------------- 2023-06-23T18:45:16.143 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: proto: precision = 0.061 usec (-24) 2023-06-23T18:45:16.144 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: basedate set to 2022-02-04 2023-06-23T18:45:16.144 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: gps base set to 2022-02-06 (week 2196) 2023-06-23T18:45:16.144 INFO:teuthology.orchestra.run.smithi164.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.144 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-23T18:45:16.144 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Command line: ntpd -gq 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: ---------------------------------------------------- 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: ntp-4 is maintained by Network Time Foundation, 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: corporation. Support and training for ntp-4 are 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: available at https://www.nwtime.org/support 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: ---------------------------------------------------- 2023-06-23T18:45:16.145 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: proto: precision = 0.061 usec (-24) 2023-06-23T18:45:16.146 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: basedate set to 2022-02-04 2023-06-23T18:45:16.146 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: gps base set to 2022-02-06 (week 2196) 2023-06-23T18:45:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.146 INFO:teuthology.orchestra.run.smithi118.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.147 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.147 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.148 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.148 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.148 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.149 INFO:teuthology.orchestra.run.smithi118.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.151 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T18:45:16.151 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T18:45:16.151 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T18:45:16.151 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen normally on 3 enp3s0f1 172.21.15.164:123 2023-06-23T18:45:16.151 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen normally on 4 lo [::1]:123 2023-06-23T18:45:16.152 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:73f3%5]:123 2023-06-23T18:45:16.152 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:16 ntpd[27410]: Listening on routing socket on fd #22 for interface updates 2023-06-23T18:45:16.152 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T18:45:16.152 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T18:45:16.152 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen normally on 3 enp3s0f1 172.21.15.118:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen normally on 4 lo [::1]:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d725%5]:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:16 ntpd[27423]: Listening on routing socket on fd #22 for interface updates 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T18:45:16.153 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T18:45:16.154 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2023-06-23T18:45:16.154 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen normally on 4 lo [::1]:123 2023-06-23T18:45:16.154 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2023-06-23T18:45:16.154 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:16 ntpd[27454]: Listening on routing socket on fd #22 for interface updates 2023-06-23T18:45:16.165 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-23T18:45:16.165 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Command line: ntpd -gq 2023-06-23T18:45:16.165 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: ---------------------------------------------------- 2023-06-23T18:45:16.166 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: ntp-4 is maintained by Network Time Foundation, 2023-06-23T18:45:16.166 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-23T18:45:16.166 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: corporation. Support and training for ntp-4 are 2023-06-23T18:45:16.166 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: available at https://www.nwtime.org/support 2023-06-23T18:45:16.166 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: ---------------------------------------------------- 2023-06-23T18:45:16.167 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: proto: precision = 0.055 usec (-24) 2023-06-23T18:45:16.167 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: basedate set to 2022-02-04 2023-06-23T18:45:16.167 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: gps base set to 2022-02-06 (week 2196) 2023-06-23T18:45:16.167 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.167 INFO:teuthology.orchestra.run.smithi192.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T18:45:16.168 INFO:teuthology.orchestra.run.smithi192.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.168 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T18:45:16.169 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T18:45:16.169 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T18:45:16.169 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T18:45:16.169 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen normally on 3 enp3s0f1 172.21.15.192:123 2023-06-23T18:45:16.169 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen normally on 4 lo [::1]:123 2023-06-23T18:45:16.170 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8049%5]:123 2023-06-23T18:45:16.170 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:16 ntpd[27462]: Listening on routing socket on fd #22 for interface updates 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:17 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:17 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:17 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:17 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:17 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:17.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:17.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:17.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:17.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:17 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:18.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:18 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:18 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:18.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:18 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:19 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:19 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:19 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:19 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:19.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:19 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:20 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:20 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:20.139 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.139 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.139 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:20 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.141 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.141 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:20.141 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:20 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:20.165 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:20.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:20.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:20.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:20 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:21 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:21 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:21 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.144 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:21 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:21 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:22.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:22 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:22 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:22 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:22 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:22.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:22 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.136 INFO:teuthology.orchestra.run.smithi038.stdout:23 Jun 18:45:23 ntpd[27352]: ntpd: time slew +0.001490 s 2023-06-23T18:45:23.136 INFO:teuthology.orchestra.run.smithi038.stdout:ntpd: time slew +0.001490s 2023-06-23T18:45:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T18:45:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:23 Jun 18:45:23 ntpd[27352]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T18:45:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.142 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:23 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.144 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.145 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.145 INFO:teuthology.orchestra.run.smithi164.stdout:23 Jun 18:45:23 ntpd[27410]: ntpd: time slew +0.001736 s 2023-06-23T18:45:23.145 INFO:teuthology.orchestra.run.smithi164.stdout:ntpd: time slew +0.001736s 2023-06-23T18:45:23.146 INFO:teuthology.orchestra.run.smithi081.stdout:23 Jun 18:45:23 ntpd[27454]: ntpd: time slew +0.003857 s 2023-06-23T18:45:23.146 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.003857s 2023-06-23T18:45:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T18:45:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:23 Jun 18:45:23 ntpd[27410]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T18:45:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T18:45:23.147 INFO:teuthology.orchestra.run.smithi081.stderr:23 Jun 18:45:23 ntpd[27454]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T18:45:23.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.166 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:23.167 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:23.168 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:23.168 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 18:45:23 ntpd[27462]: ntpd: time slew -0.001194 s 2023-06-23T18:45:23.168 INFO:teuthology.orchestra.run.smithi192.stdout:ntpd: time slew -0.001194s 2023-06-23T18:45:23.169 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T18:45:23.169 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 18:45:23 ntpd[27462]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T18:45:23.226 INFO:teuthology.orchestra.run.smithi038.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:45:23.226 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================== 2023-06-23T18:45:23.226 INFO:teuthology.orchestra.run.smithi038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.227 INFO:teuthology.orchestra.run.smithi038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.227 INFO:teuthology.orchestra.run.smithi038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.227 INFO:teuthology.orchestra.run.smithi038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:45:23.235 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-06-23T18:45:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.237 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:45:23.237 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-06-23T18:45:23.237 INFO:teuthology.orchestra.run.smithi192.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.237 INFO:teuthology.orchestra.run.smithi192.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.238 INFO:teuthology.orchestra.run.smithi192.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.238 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.241 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:45:23.242 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2023-06-23T18:45:23.242 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.242 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.242 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:23.242 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:24.138 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:24.138 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:24.138 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T18:45:24.138 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T18:45:24.138 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T18:45:24.139 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T18:45:24.139 INFO:teuthology.orchestra.run.smithi118.stdout:23 Jun 18:45:24 ntpd[27423]: ntpd: time slew -0.005124 s 2023-06-23T18:45:24.139 INFO:teuthology.orchestra.run.smithi118.stdout:ntpd: time slew -0.005124s 2023-06-23T18:45:24.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T18:45:24.140 INFO:teuthology.orchestra.run.smithi118.stderr:23 Jun 18:45:24 ntpd[27423]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T18:45:24.220 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:45:24.220 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2023-06-23T18:45:24.220 INFO:teuthology.orchestra.run.smithi118.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:24.220 INFO:teuthology.orchestra.run.smithi118.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:24.220 INFO:teuthology.orchestra.run.smithi118.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:24.221 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:45:24.221 INFO:teuthology.run_tasks:Running task install... 2023-06-23T18:45:24.231 DEBUG:teuthology.task.install:project ceph 2023-06-23T18:45:24.232 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}} 2023-06-23T18:45:24.232 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'} 2023-06-23T18:45:24.232 INFO:teuthology.task.install:Using flavor: default 2023-06-23T18:45:24.238 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-23T18:45:24.238 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-23T18:45:24.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-key list | grep Ceph 2023-06-23T18:45:24.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2023-06-23T18:45:24.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2023-06-23T18:45:24.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-key list | grep Ceph 2023-06-23T18:45:24.241 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-key list | grep Ceph 2023-06-23T18:45:24.306 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-23T18:45:24.307 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-23T18:45:24.309 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-23T18:45:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-23T18:45:24.321 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-23T18:45:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T18:45:24.335 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T18:45:24.337 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T18:45:24.337 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T18:45:24.337 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T18:45:24.337 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-23T18:45:24.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:45:24.340 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T18:45:24.340 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-23T18:45:24.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:45:24.344 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T18:45:24.344 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T18:45:24.344 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T18:45:24.344 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-23T18:45:24.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:45:24.347 INFO:teuthology.orchestra.run.smithi038.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T18:45:24.347 INFO:teuthology.orchestra.run.smithi038.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T18:45:24.347 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T18:45:24.348 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-23T18:45:24.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:45:24.350 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T18:45:24.350 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T18:45:24.350 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T18:45:24.351 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-23T18:45:24.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:45:24.482 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default/ 2023-06-23T18:45:24.482 INFO:teuthology.task.install.deb:Package version is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:24.486 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default/ 2023-06-23T18:45:24.486 INFO:teuthology.task.install.deb:Package version is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:24.491 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default/ 2023-06-23T18:45:24.491 INFO:teuthology.task.install.deb:Package version is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:24.500 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default/ 2023-06-23T18:45:24.500 INFO:teuthology.task.install.deb:Package version is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:24.555 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default/ 2023-06-23T18:45:24.556 INFO:teuthology.task.install.deb:Package version is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:24.643 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:45:24.643 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T18:45:24.657 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-06-23T18:45:24.664 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:45:24.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T18:45:24.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-23T18:45:24.703 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:45:24.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T18:45:24.712 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:45:24.713 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T18:45:24.713 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:45:24.713 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T18:45:24.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo apt-get update 2023-06-23T18:45:24.726 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2023-06-23T18:45:24.727 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T18:45:24.823 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:45:24.841 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:45:24.883 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-23T18:45:24.884 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:45:24.885 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:45:24.888 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:45:24.888 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:45:24.890 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:45:24.895 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:45:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:45:24.900 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:45:24.913 INFO:teuthology.orchestra.run.smithi038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:45:24.916 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:45:24.917 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:45:24.931 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-23T18:45:24.933 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-23T18:45:24.945 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:45:24.962 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-23T18:45:24.984 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-23T18:45:24.985 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-23T18:45:25.012 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-23T18:45:25.031 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:45:25.040 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-23T18:45:25.042 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-23T18:45:25.043 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-23T18:45:25.055 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-23T18:45:25.056 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-23T18:45:25.099 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-23T18:45:25.109 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:45:25.114 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-23T18:45:25.114 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-23T18:45:25.115 INFO:teuthology.orchestra.run.smithi038.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-23T18:45:25.125 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-23T18:45:25.176 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-23T18:45:25.177 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-23T18:45:25.191 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-23T18:45:25.229 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-23T18:45:25.229 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-23T18:45:25.247 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-23T18:45:25.248 INFO:teuthology.orchestra.run.smithi038.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-23T18:45:25.259 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-23T18:45:25.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-23T18:45:25.264 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-23T18:45:25.284 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-23T18:45:25.321 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 28.6 kB in 0s (59.2 kB/s) 2023-06-23T18:45:25.336 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 28.6 kB in 0s (66.2 kB/s) 2023-06-23T18:45:25.339 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 28.6 kB in 0s (66.5 kB/s) 2023-06-23T18:45:25.343 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.6 kB in 0s (59.7 kB/s) 2023-06-23T18:45:25.377 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-23T18:45:25.472 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 28.6 kB in 1s (51.6 kB/s) 2023-06-23T18:45:26.086 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:45:26.103 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4479-g8627af3e-1jammy cephadm=18.0.0-4479-g8627af3e-1jammy ceph-mds=18.0.0-4479-g8627af3e-1jammy ceph-mgr=18.0.0-4479-g8627af3e-1jammy ceph-common=18.0.0-4479-g8627af3e-1jammy ceph-fuse=18.0.0-4479-g8627af3e-1jammy ceph-test=18.0.0-4479-g8627af3e-1jammy ceph-volume=18.0.0-4479-g8627af3e-1jammy radosgw=18.0.0-4479-g8627af3e-1jammy python3-rados=18.0.0-4479-g8627af3e-1jammy python3-rgw=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy python3-rbd=18.0.0-4479-g8627af3e-1jammy libcephfs2=18.0.0-4479-g8627af3e-1jammy libcephfs-dev=18.0.0-4479-g8627af3e-1jammy librados2=18.0.0-4479-g8627af3e-1jammy librbd1=18.0.0-4479-g8627af3e-1jammy rbd-fuse=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy cephfs-shell=18.0.0-4479-g8627af3e-1jammy cephfs-top=18.0.0-4479-g8627af3e-1jammy cephfs-mirror=18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:26.111 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:45:26.127 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:45:26.128 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4479-g8627af3e-1jammy cephadm=18.0.0-4479-g8627af3e-1jammy ceph-mds=18.0.0-4479-g8627af3e-1jammy ceph-mgr=18.0.0-4479-g8627af3e-1jammy ceph-common=18.0.0-4479-g8627af3e-1jammy ceph-fuse=18.0.0-4479-g8627af3e-1jammy ceph-test=18.0.0-4479-g8627af3e-1jammy ceph-volume=18.0.0-4479-g8627af3e-1jammy radosgw=18.0.0-4479-g8627af3e-1jammy python3-rados=18.0.0-4479-g8627af3e-1jammy python3-rgw=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy python3-rbd=18.0.0-4479-g8627af3e-1jammy libcephfs2=18.0.0-4479-g8627af3e-1jammy libcephfs-dev=18.0.0-4479-g8627af3e-1jammy librados2=18.0.0-4479-g8627af3e-1jammy librbd1=18.0.0-4479-g8627af3e-1jammy rbd-fuse=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy cephfs-shell=18.0.0-4479-g8627af3e-1jammy cephfs-top=18.0.0-4479-g8627af3e-1jammy cephfs-mirror=18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:26.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4479-g8627af3e-1jammy cephadm=18.0.0-4479-g8627af3e-1jammy ceph-mds=18.0.0-4479-g8627af3e-1jammy ceph-mgr=18.0.0-4479-g8627af3e-1jammy ceph-common=18.0.0-4479-g8627af3e-1jammy ceph-fuse=18.0.0-4479-g8627af3e-1jammy ceph-test=18.0.0-4479-g8627af3e-1jammy ceph-volume=18.0.0-4479-g8627af3e-1jammy radosgw=18.0.0-4479-g8627af3e-1jammy python3-rados=18.0.0-4479-g8627af3e-1jammy python3-rgw=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy python3-rbd=18.0.0-4479-g8627af3e-1jammy libcephfs2=18.0.0-4479-g8627af3e-1jammy libcephfs-dev=18.0.0-4479-g8627af3e-1jammy librados2=18.0.0-4479-g8627af3e-1jammy librbd1=18.0.0-4479-g8627af3e-1jammy rbd-fuse=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy cephfs-shell=18.0.0-4479-g8627af3e-1jammy cephfs-top=18.0.0-4479-g8627af3e-1jammy cephfs-mirror=18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:26.153 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:45:26.155 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:45:26.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4479-g8627af3e-1jammy cephadm=18.0.0-4479-g8627af3e-1jammy ceph-mds=18.0.0-4479-g8627af3e-1jammy ceph-mgr=18.0.0-4479-g8627af3e-1jammy ceph-common=18.0.0-4479-g8627af3e-1jammy ceph-fuse=18.0.0-4479-g8627af3e-1jammy ceph-test=18.0.0-4479-g8627af3e-1jammy ceph-volume=18.0.0-4479-g8627af3e-1jammy radosgw=18.0.0-4479-g8627af3e-1jammy python3-rados=18.0.0-4479-g8627af3e-1jammy python3-rgw=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy python3-rbd=18.0.0-4479-g8627af3e-1jammy libcephfs2=18.0.0-4479-g8627af3e-1jammy libcephfs-dev=18.0.0-4479-g8627af3e-1jammy librados2=18.0.0-4479-g8627af3e-1jammy librbd1=18.0.0-4479-g8627af3e-1jammy rbd-fuse=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy cephfs-shell=18.0.0-4479-g8627af3e-1jammy cephfs-top=18.0.0-4479-g8627af3e-1jammy cephfs-mirror=18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:26.188 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:45:26.206 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:45:26.228 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:45:26.301 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:45:26.312 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T18:45:26.312 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T18:45:26.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4479-g8627af3e-1jammy cephadm=18.0.0-4479-g8627af3e-1jammy ceph-mds=18.0.0-4479-g8627af3e-1jammy ceph-mgr=18.0.0-4479-g8627af3e-1jammy ceph-common=18.0.0-4479-g8627af3e-1jammy ceph-fuse=18.0.0-4479-g8627af3e-1jammy ceph-test=18.0.0-4479-g8627af3e-1jammy ceph-volume=18.0.0-4479-g8627af3e-1jammy radosgw=18.0.0-4479-g8627af3e-1jammy python3-rados=18.0.0-4479-g8627af3e-1jammy python3-rgw=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy python3-rbd=18.0.0-4479-g8627af3e-1jammy libcephfs2=18.0.0-4479-g8627af3e-1jammy libcephfs-dev=18.0.0-4479-g8627af3e-1jammy librados2=18.0.0-4479-g8627af3e-1jammy librbd1=18.0.0-4479-g8627af3e-1jammy rbd-fuse=18.0.0-4479-g8627af3e-1jammy python3-cephfs=18.0.0-4479-g8627af3e-1jammy cephfs-shell=18.0.0-4479-g8627af3e-1jammy cephfs-top=18.0.0-4479-g8627af3e-1jammy cephfs-mirror=18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:45:26.354 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-06-23T18:45:26.355 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-06-23T18:45:26.380 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:45:26.380 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-06-23T18:45:26.381 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-06-23T18:45:26.403 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-23T18:45:26.404 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-23T18:45:26.454 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:45:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:45:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:45:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:45:26.455 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:45:26.456 INFO:teuthology.orchestra.run.smithi192.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:45:26.456 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:45:26.457 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T18:45:26.457 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T18:45:26.457 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-23T18:45:26.457 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.457 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-23T18:45:26.458 INFO:teuthology.orchestra.run.smithi192.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-23T18:45:26.459 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-23T18:45:26.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-23T18:45:26.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-23T18:45:26.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-23T18:45:26.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-23T18:45:26.460 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-23T18:45:26.461 INFO:teuthology.orchestra.run.smithi192.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-23T18:45:26.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-watchdog 2023-06-23T18:45:26.462 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-06-23T18:45:26.462 INFO:teuthology.orchestra.run.smithi192.stdout: btrfs-tools 2023-06-23T18:45:26.514 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:45:26.514 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:45:26.514 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:45:26.514 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:45:26.515 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-23T18:45:26.516 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-23T18:45:26.517 INFO:teuthology.orchestra.run.smithi118.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-23T18:45:26.518 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-23T18:45:26.519 INFO:teuthology.orchestra.run.smithi118.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T18:45:26.520 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-06-23T18:45:26.520 INFO:teuthology.orchestra.run.smithi118.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-23T18:45:26.520 INFO:teuthology.orchestra.run.smithi118.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-23T18:45:26.520 INFO:teuthology.orchestra.run.smithi118.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-23T18:45:26.520 INFO:teuthology.orchestra.run.smithi118.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-23T18:45:26.521 INFO:teuthology.orchestra.run.smithi118.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-23T18:45:26.521 INFO:teuthology.orchestra.run.smithi118.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-23T18:45:26.521 INFO:teuthology.orchestra.run.smithi118.stdout: python3-watchdog 2023-06-23T18:45:26.521 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2023-06-23T18:45:26.521 INFO:teuthology.orchestra.run.smithi118.stdout: btrfs-tools 2023-06-23T18:45:26.541 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:45:26.541 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:45:26.541 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:45:26.541 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:45:26.541 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:45:26.543 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:45:26.543 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:45:26.543 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2023-06-23T18:45:26.543 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T18:45:26.543 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-23T18:45:26.544 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-23T18:45:26.545 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-23T18:45:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T18:45:26.547 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2023-06-23T18:45:26.547 INFO:teuthology.orchestra.run.smithi164.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-23T18:45:26.547 INFO:teuthology.orchestra.run.smithi164.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-23T18:45:26.547 INFO:teuthology.orchestra.run.smithi164.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout: python3-watchdog 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2023-06-23T18:45:26.548 INFO:teuthology.orchestra.run.smithi164.stdout: btrfs-tools 2023-06-23T18:45:26.554 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2023-06-23T18:45:26.555 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2023-06-23T18:45:26.556 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T18:45:26.557 INFO:teuthology.orchestra.run.smithi192.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T18:45:26.557 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T18:45:26.557 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T18:45:26.558 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-23T18:45:26.558 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.559 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-23T18:45:26.559 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-23T18:45:26.559 INFO:teuthology.orchestra.run.smithi192.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-23T18:45:26.559 INFO:teuthology.orchestra.run.smithi192.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-23T18:45:26.559 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-23T18:45:26.560 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-23T18:45:26.560 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-23T18:45:26.560 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-23T18:45:26.561 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-23T18:45:26.562 INFO:teuthology.orchestra.run.smithi192.stdout: socat xmlstarlet 2023-06-23T18:45:26.564 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:45:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:45:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:45:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:45:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:45:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:45:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:45:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-23T18:45:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T18:45:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-23T18:45:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-23T18:45:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-23T18:45:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-23T18:45:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-23T18:45:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-23T18:45:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-23T18:45:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-23T18:45:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-23T18:45:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-23T18:45:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-23T18:45:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-23T18:45:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-23T18:45:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-23T18:45:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-23T18:45:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-23T18:45:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-23T18:45:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-23T18:45:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-23T18:45:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-23T18:45:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T18:45:26.574 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-23T18:45:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-23T18:45:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-23T18:45:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-23T18:45:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-23T18:45:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-23T18:45:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-23T18:45:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: python3-watchdog 2023-06-23T18:45:26.576 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-06-23T18:45:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2023-06-23T18:45:26.622 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-06-23T18:45:26.622 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T18:45:26.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T18:45:26.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T18:45:26.623 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-23T18:45:26.624 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.624 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-23T18:45:26.624 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-23T18:45:26.625 INFO:teuthology.orchestra.run.smithi118.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-23T18:45:26.625 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-23T18:45:26.625 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-23T18:45:26.625 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-23T18:45:26.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-23T18:45:26.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-23T18:45:26.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-23T18:45:26.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-23T18:45:26.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-23T18:45:26.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-23T18:45:26.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-23T18:45:26.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-23T18:45:26.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-23T18:45:26.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T18:45:26.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-23T18:45:26.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-23T18:45:26.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-23T18:45:26.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-23T18:45:26.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-23T18:45:26.630 INFO:teuthology.orchestra.run.smithi118.stdout: socat xmlstarlet 2023-06-23T18:45:26.651 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2023-06-23T18:45:26.651 INFO:teuthology.orchestra.run.smithi164.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T18:45:26.651 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T18:45:26.652 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T18:45:26.652 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-23T18:45:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-23T18:45:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-23T18:45:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-23T18:45:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-23T18:45:26.654 INFO:teuthology.orchestra.run.smithi164.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-23T18:45:26.655 INFO:teuthology.orchestra.run.smithi164.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-23T18:45:26.656 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-23T18:45:26.656 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-23T18:45:26.656 INFO:teuthology.orchestra.run.smithi164.stdout: socat xmlstarlet 2023-06-23T18:45:26.661 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-23T18:45:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T18:45:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T18:45:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T18:45:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-23T18:45:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.663 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-23T18:45:26.664 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-23T18:45:26.665 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-23T18:45:26.666 INFO:teuthology.orchestra.run.smithi081.stdout: socat xmlstarlet 2023-06-23T18:45:26.681 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 115 newly installed, 0 to remove and 200 not upgraded. 2023-06-23T18:45:26.681 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 183 MB of archives. 2023-06-23T18:45:26.682 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-23T18:45:26.682 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-23T18:45:26.698 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-23T18:45:26.708 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-23T18:45:26.721 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:45:26.722 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:45:26.722 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:45:26.722 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:45:26.723 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:45:26.724 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:45:26.725 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:45:26.725 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2023-06-23T18:45:26.725 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T18:45:26.726 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-23T18:45:26.726 INFO:teuthology.orchestra.run.smithi038.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.726 INFO:teuthology.orchestra.run.smithi038.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-23T18:45:26.726 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-23T18:45:26.727 INFO:teuthology.orchestra.run.smithi038.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-23T18:45:26.727 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-23T18:45:26.727 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-23T18:45:26.727 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-23T18:45:26.728 INFO:teuthology.orchestra.run.smithi038.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-23T18:45:26.728 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-23T18:45:26.728 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-23T18:45:26.729 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-23T18:45:26.729 INFO:teuthology.orchestra.run.smithi038.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-23T18:45:26.729 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-23T18:45:26.729 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-23T18:45:26.730 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-23T18:45:26.730 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-23T18:45:26.730 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-23T18:45:26.730 INFO:teuthology.orchestra.run.smithi038.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-23T18:45:26.731 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-23T18:45:26.731 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-23T18:45:26.731 INFO:teuthology.orchestra.run.smithi038.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T18:45:26.732 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2023-06-23T18:45:26.732 INFO:teuthology.orchestra.run.smithi038.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-23T18:45:26.732 INFO:teuthology.orchestra.run.smithi038.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-23T18:45:26.733 INFO:teuthology.orchestra.run.smithi038.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-23T18:45:26.733 INFO:teuthology.orchestra.run.smithi038.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-23T18:45:26.733 INFO:teuthology.orchestra.run.smithi038.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-23T18:45:26.733 INFO:teuthology.orchestra.run.smithi038.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-23T18:45:26.734 INFO:teuthology.orchestra.run.smithi038.stdout: python3-watchdog 2023-06-23T18:45:26.734 INFO:teuthology.orchestra.run.smithi038.stdout:Recommended packages: 2023-06-23T18:45:26.734 INFO:teuthology.orchestra.run.smithi038.stdout: btrfs-tools 2023-06-23T18:45:26.744 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 115 newly installed, 0 to remove and 200 not upgraded. 2023-06-23T18:45:26.744 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 183 MB of archives. 2023-06-23T18:45:26.744 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-23T18:45:26.745 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-23T18:45:26.748 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-23T18:45:26.757 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-23T18:45:26.773 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-23T18:45:26.776 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-23T18:45:26.786 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-23T18:45:26.826 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-23T18:45:26.833 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-23T18:45:26.834 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2023-06-23T18:45:26.834 INFO:teuthology.orchestra.run.smithi038.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T18:45:26.834 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T18:45:26.834 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T18:45:26.834 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-23T18:45:26.835 INFO:teuthology.orchestra.run.smithi038.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-23T18:45:26.835 INFO:teuthology.orchestra.run.smithi038.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-23T18:45:26.835 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-23T18:45:26.836 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-23T18:45:26.837 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-23T18:45:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: socat xmlstarlet 2023-06-23T18:45:26.839 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 115 newly installed, 0 to remove and 200 not upgraded. 2023-06-23T18:45:26.839 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 183 MB of archives. 2023-06-23T18:45:26.839 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-23T18:45:26.839 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-23T18:45:26.839 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-23T18:45:26.847 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-23T18:45:26.849 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 115 newly installed, 0 to remove and 200 not upgraded. 2023-06-23T18:45:26.849 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 183 MB of archives. 2023-06-23T18:45:26.849 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-23T18:45:26.850 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-23T18:45:26.872 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-23T18:45:26.885 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-23T18:45:26.894 INFO:teuthology.orchestra.run.smithi038.stdout:0 upgraded, 115 newly installed, 0 to remove and 200 not upgraded. 2023-06-23T18:45:26.895 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 183 MB of archives. 2023-06-23T18:45:26.895 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-23T18:45:26.895 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-23T18:45:26.913 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-23T18:45:26.920 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-23T18:45:26.921 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-23T18:45:26.922 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4479-g8627af3e-1jammy [3,389 kB] 2023-06-23T18:45:26.922 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4479-g8627af3e-1jammy [3,389 kB] 2023-06-23T18:45:26.924 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4479-g8627af3e-1jammy [3,389 kB] 2023-06-23T18:45:26.926 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-23T18:45:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-23T18:45:26.962 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-23T18:45:26.965 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-23T18:45:26.971 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-23T18:45:26.977 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-23T18:45:26.988 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-23T18:45:26.990 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-23T18:45:26.993 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4479-g8627af3e-1jammy [3,389 kB] 2023-06-23T18:45:27.000 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-23T18:45:27.002 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-23T18:45:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-23T18:45:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-23T18:45:27.007 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-23T18:45:27.007 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-23T18:45:27.008 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-23T18:45:27.045 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-23T18:45:27.046 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-23T18:45:27.050 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-23T18:45:27.056 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4479-g8627af3e-1jammy [3,389 kB] 2023-06-23T18:45:27.061 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-23T18:45:27.062 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-23T18:45:27.065 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-23T18:45:27.067 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-23T18:45:27.069 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-23T18:45:27.099 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-23T18:45:27.109 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-23T18:45:27.120 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-23T18:45:27.123 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-23T18:45:27.125 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-23T18:45:27.126 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-23T18:45:27.131 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T18:45:27.132 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-23T18:45:27.133 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-23T18:45:27.141 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-23T18:45:27.161 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-23T18:45:27.172 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-23T18:45:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-23T18:45:27.184 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-23T18:45:27.196 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-23T18:45:27.205 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-23T18:45:27.216 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-23T18:45:27.217 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-23T18:45:27.218 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-23T18:45:27.219 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-23T18:45:27.221 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-23T18:45:27.222 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-23T18:45:27.222 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-23T18:45:27.223 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-23T18:45:27.225 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-23T18:45:27.228 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-23T18:45:27.241 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-23T18:45:27.260 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-23T18:45:27.260 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-23T18:45:27.277 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-23T18:45:27.279 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-23T18:45:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-23T18:45:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-23T18:45:27.287 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-23T18:45:27.288 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-23T18:45:27.290 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-23T18:45:27.291 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-23T18:45:27.292 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-23T18:45:27.297 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-23T18:45:27.299 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-23T18:45:27.302 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-06-23T18:45:27.302 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-23T18:45:27.316 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4479-g8627af3e-1jammy [3,095 kB] 2023-06-23T18:45:27.333 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-23T18:45:27.336 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-23T18:45:27.337 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-23T18:45:27.338 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-23T18:45:27.339 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-23T18:45:27.340 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-23T18:45:27.345 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T18:45:27.346 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-23T18:45:27.347 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-23T18:45:27.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-23T18:45:27.352 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-23T18:45:27.389 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-23T18:45:27.392 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4479-g8627af3e-1jammy [3,095 kB] 2023-06-23T18:45:27.407 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-23T18:45:27.415 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-23T18:45:27.423 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-23T18:45:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-23T18:45:27.426 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-23T18:45:27.442 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-23T18:45:27.442 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-23T18:45:27.485 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4479-g8627af3e-1jammy [3,095 kB] 2023-06-23T18:45:27.500 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-23T18:45:27.501 INFO:teuthology.orchestra.run.smithi038.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-23T18:45:27.502 INFO:teuthology.orchestra.run.smithi038.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-23T18:45:27.502 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-23T18:45:27.503 INFO:teuthology.orchestra.run.smithi038.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-23T18:45:27.507 INFO:teuthology.orchestra.run.smithi038.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-23T18:45:27.513 INFO:teuthology.orchestra.run.smithi038.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-23T18:45:27.514 INFO:teuthology.orchestra.run.smithi038.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-23T18:45:27.515 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-23T18:45:27.517 INFO:teuthology.orchestra.run.smithi038.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-06-23T18:45:27.518 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-23T18:45:27.519 INFO:teuthology.orchestra.run.smithi038.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-23T18:45:27.526 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-23T18:45:27.541 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-23T18:45:27.547 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-23T18:45:27.548 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-23T18:45:27.549 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-23T18:45:27.550 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T18:45:27.550 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-23T18:45:27.551 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-23T18:45:27.552 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-23T18:45:27.558 INFO:teuthology.orchestra.run.smithi038.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-23T18:45:27.569 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-23T18:45:27.576 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4479-g8627af3e-1jammy [657 kB] 2023-06-23T18:45:27.606 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-23T18:45:27.610 INFO:teuthology.orchestra.run.smithi038.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-23T18:45:27.614 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-23T18:45:27.635 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4479-g8627af3e-1jammy [344 kB] 2023-06-23T18:45:27.642 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-23T18:45:27.648 INFO:teuthology.orchestra.run.smithi038.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-23T18:45:27.677 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4479-g8627af3e-1jammy [22.9 kB] 2023-06-23T18:45:27.677 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4479-g8627af3e-1jammy [170 kB] 2023-06-23T18:45:27.687 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4479-g8627af3e-1jammy [49.0 kB] 2023-06-23T18:45:27.689 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4479-g8627af3e-1jammy [319 kB] 2023-06-23T18:45:27.708 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4479-g8627af3e-1jammy [6,063 kB] 2023-06-23T18:45:27.712 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-23T18:45:27.724 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-23T18:45:27.755 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-23T18:45:27.755 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-23T18:45:27.757 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-23T18:45:27.758 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-23T18:45:27.759 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-23T18:45:27.760 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-23T18:45:27.761 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-23T18:45:27.761 INFO:teuthology.orchestra.run.smithi038.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-23T18:45:27.762 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-23T18:45:27.762 INFO:teuthology.orchestra.run.smithi038.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-23T18:45:27.764 INFO:teuthology.orchestra.run.smithi038.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-23T18:45:27.764 INFO:teuthology.orchestra.run.smithi038.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T18:45:27.765 INFO:teuthology.orchestra.run.smithi038.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-23T18:45:27.769 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-23T18:45:27.784 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4479-g8627af3e-1jammy [657 kB] 2023-06-23T18:45:27.786 INFO:teuthology.orchestra.run.smithi038.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-23T18:45:27.806 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-23T18:45:27.808 INFO:teuthology.orchestra.run.smithi038.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-23T18:45:27.810 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-23T18:45:27.810 INFO:teuthology.orchestra.run.smithi038.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-23T18:45:27.846 INFO:teuthology.orchestra.run.smithi038.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-23T18:45:27.851 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4479-g8627af3e-1jammy [344 kB] 2023-06-23T18:45:27.867 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4479-g8627af3e-1jammy [22.9 kB] 2023-06-23T18:45:27.883 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-23T18:45:27.888 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-23T18:45:27.895 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4479-g8627af3e-1jammy [170 kB] 2023-06-23T18:45:27.902 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4479-g8627af3e-1jammy [657 kB] 2023-06-23T18:45:27.907 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-23T18:45:27.913 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4479-g8627af3e-1jammy [49.0 kB] 2023-06-23T18:45:27.916 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4479-g8627af3e-1jammy [319 kB] 2023-06-23T18:45:27.920 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-23T18:45:27.920 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-23T18:45:27.932 INFO:teuthology.orchestra.run.smithi118.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-23T18:45:27.932 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4479-g8627af3e-1jammy [6,063 kB] 2023-06-23T18:45:27.933 INFO:teuthology.orchestra.run.smithi118.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-23T18:45:27.946 INFO:teuthology.orchestra.run.smithi118.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-23T18:45:27.954 INFO:teuthology.orchestra.run.smithi118.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-23T18:45:27.955 INFO:teuthology.orchestra.run.smithi118.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T18:45:27.956 INFO:teuthology.orchestra.run.smithi118.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-23T18:45:27.957 INFO:teuthology.orchestra.run.smithi118.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-23T18:45:27.983 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4479-g8627af3e-1jammy [344 kB] 2023-06-23T18:45:27.995 INFO:teuthology.orchestra.run.smithi038.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-23T18:45:27.996 INFO:teuthology.orchestra.run.smithi118.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-23T18:45:27.996 INFO:teuthology.orchestra.run.smithi038.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-23T18:45:27.998 INFO:teuthology.orchestra.run.smithi038.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-23T18:45:27.999 INFO:teuthology.orchestra.run.smithi038.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-23T18:45:28.000 INFO:teuthology.orchestra.run.smithi038.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-23T18:45:28.002 INFO:teuthology.orchestra.run.smithi038.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-23T18:45:28.002 INFO:teuthology.orchestra.run.smithi038.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-23T18:45:28.004 INFO:teuthology.orchestra.run.smithi038.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-23T18:45:28.012 INFO:teuthology.orchestra.run.smithi038.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-23T18:45:28.013 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4479-g8627af3e-1jammy [22.9 kB] 2023-06-23T18:45:28.015 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4479-g8627af3e-1jammy [170 kB] 2023-06-23T18:45:28.016 INFO:teuthology.orchestra.run.smithi038.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-23T18:45:28.054 INFO:teuthology.orchestra.run.smithi038.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi118.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4479-g8627af3e-1jammy [49.0 kB] 2023-06-23T18:45:28.065 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4479-g8627af3e-1jammy [319 kB] 2023-06-23T18:45:28.095 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4479-g8627af3e-1jammy [6,063 kB] 2023-06-23T18:45:28.108 INFO:teuthology.orchestra.run.smithi038.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-23T18:45:28.120 INFO:teuthology.orchestra.run.smithi118.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-23T18:45:28.121 INFO:teuthology.orchestra.run.smithi118.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-23T18:45:28.122 INFO:teuthology.orchestra.run.smithi118.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-23T18:45:28.127 INFO:teuthology.orchestra.run.smithi118.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-23T18:45:28.129 INFO:teuthology.orchestra.run.smithi118.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-23T18:45:28.158 INFO:teuthology.orchestra.run.smithi038.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-23T18:45:28.171 INFO:teuthology.orchestra.run.smithi038.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-23T18:45:28.172 INFO:teuthology.orchestra.run.smithi038.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-23T18:45:28.173 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-23T18:45:28.180 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-23T18:45:28.182 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-23T18:45:28.185 INFO:teuthology.orchestra.run.smithi038.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-23T18:45:28.193 INFO:teuthology.orchestra.run.smithi038.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-23T18:45:28.194 INFO:teuthology.orchestra.run.smithi038.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T18:45:28.194 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-23T18:45:28.195 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-23T18:45:28.196 INFO:teuthology.orchestra.run.smithi038.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-23T18:45:28.196 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-23T18:45:28.196 INFO:teuthology.orchestra.run.smithi038.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-23T18:45:28.198 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-23T18:45:28.200 INFO:teuthology.orchestra.run.smithi038.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-23T18:45:28.200 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-23T18:45:28.201 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-23T18:45:28.237 INFO:teuthology.orchestra.run.smithi038.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-23T18:45:28.251 INFO:teuthology.orchestra.run.smithi118.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4479-g8627af3e-1jammy [102 kB] 2023-06-23T18:45:28.258 INFO:teuthology.orchestra.run.smithi118.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4479-g8627af3e-1jammy [429 kB] 2023-06-23T18:45:28.271 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-23T18:45:28.278 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-23T18:45:28.280 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-23T18:45:28.284 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-23T18:45:28.291 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-23T18:45:28.292 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-23T18:45:28.293 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-23T18:45:28.293 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-23T18:45:28.294 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-23T18:45:28.296 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-23T18:45:28.298 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-23T18:45:28.300 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-23T18:45:28.305 INFO:teuthology.orchestra.run.smithi118.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4479-g8627af3e-1jammy [22.3 MB] 2023-06-23T18:45:28.305 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-23T18:45:28.307 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-23T18:45:28.307 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-23T18:45:28.309 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-23T18:45:28.312 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-23T18:45:28.313 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-23T18:45:28.359 INFO:teuthology.orchestra.run.smithi038.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-23T18:45:28.360 INFO:teuthology.orchestra.run.smithi038.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-23T18:45:28.361 INFO:teuthology.orchestra.run.smithi038.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-23T18:45:28.366 INFO:teuthology.orchestra.run.smithi038.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-23T18:45:28.367 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-23T18:45:28.368 INFO:teuthology.orchestra.run.smithi038.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-23T18:45:28.429 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4479-g8627af3e-1jammy [3,095 kB] 2023-06-23T18:45:28.465 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-23T18:45:28.478 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-23T18:45:28.681 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4479-g8627af3e-1jammy [102 kB] 2023-06-23T18:45:28.685 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4479-g8627af3e-1jammy [429 kB] 2023-06-23T18:45:28.749 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4479-g8627af3e-1jammy [22.3 MB] 2023-06-23T18:45:28.798 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-23T18:45:28.808 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-23T18:45:28.814 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-23T18:45:28.818 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-23T18:45:28.836 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T18:45:28.839 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-23T18:45:28.841 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-23T18:45:28.883 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-23T18:45:28.896 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-23T18:45:28.897 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-23T18:45:28.902 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-23T18:45:28.906 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-23T18:45:28.910 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-23T18:45:28.911 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-23T18:45:28.915 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-23T18:45:28.919 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-23T18:45:28.925 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-23T18:45:28.929 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-23T18:45:28.933 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T18:45:28.937 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-23T18:45:28.939 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-23T18:45:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T18:45:28.950 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-23T18:45:28.952 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-23T18:45:28.980 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-23T18:45:28.994 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-23T18:45:28.995 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-23T18:45:28.999 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-23T18:45:29.004 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4479-g8627af3e-1jammy [102 kB] 2023-06-23T18:45:29.008 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-23T18:45:29.012 INFO:teuthology.orchestra.run.smithi192.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4479-g8627af3e-1jammy [429 kB] 2023-06-23T18:45:29.013 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-23T18:45:29.082 INFO:teuthology.orchestra.run.smithi192.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4479-g8627af3e-1jammy [22.3 MB] 2023-06-23T18:45:29.155 INFO:teuthology.orchestra.run.smithi192.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-23T18:45:29.237 INFO:teuthology.orchestra.run.smithi192.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-23T18:45:29.253 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-23T18:45:29.267 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-23T18:45:29.328 INFO:teuthology.orchestra.run.smithi192.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-23T18:45:29.328 INFO:teuthology.orchestra.run.smithi038.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4479-g8627af3e-1jammy [3,095 kB] 2023-06-23T18:45:29.336 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-23T18:45:29.340 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4479-g8627af3e-1jammy [657 kB] 2023-06-23T18:45:29.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-23T18:45:29.385 INFO:teuthology.orchestra.run.smithi192.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-23T18:45:29.427 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-23T18:45:29.439 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-23T18:45:29.484 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-23T18:45:29.496 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-23T18:45:29.500 INFO:teuthology.orchestra.run.smithi192.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-23T18:45:29.531 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4479-g8627af3e-1jammy [344 kB] 2023-06-23T18:45:29.583 INFO:teuthology.orchestra.run.smithi192.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-23T18:45:29.593 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4479-g8627af3e-1jammy [22.9 kB] 2023-06-23T18:45:29.593 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4479-g8627af3e-1jammy [170 kB] 2023-06-23T18:45:29.602 INFO:teuthology.orchestra.run.smithi192.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-23T18:45:29.602 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4479-g8627af3e-1jammy [49.0 kB] 2023-06-23T18:45:29.604 INFO:teuthology.orchestra.run.smithi164.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4479-g8627af3e-1jammy [319 kB] 2023-06-23T18:45:29.605 INFO:teuthology.orchestra.run.smithi164.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-23T18:45:29.619 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-23T18:45:29.632 INFO:teuthology.orchestra.run.smithi192.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-06-23T18:45:29.643 INFO:teuthology.orchestra.run.smithi192.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-23T18:45:29.675 INFO:teuthology.orchestra.run.smithi164.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4479-g8627af3e-1jammy [6,063 kB] 2023-06-23T18:45:29.680 INFO:teuthology.orchestra.run.smithi192.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-23T18:45:29.688 INFO:teuthology.orchestra.run.smithi192.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-23T18:45:29.703 INFO:teuthology.orchestra.run.smithi164.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-23T18:45:29.706 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-23T18:45:29.720 INFO:teuthology.orchestra.run.smithi164.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-23T18:45:29.725 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-23T18:45:29.752 INFO:teuthology.orchestra.run.smithi164.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-06-23T18:45:29.754 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-06-23T18:45:29.766 INFO:teuthology.orchestra.run.smithi164.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-23T18:45:29.767 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-23T18:45:29.804 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-23T18:45:29.806 INFO:teuthology.orchestra.run.smithi164.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-23T18:45:29.812 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-23T18:45:29.815 INFO:teuthology.orchestra.run.smithi164.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-23T18:45:29.879 INFO:teuthology.orchestra.run.smithi192.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-23T18:45:30.004 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-23T18:45:30.005 INFO:teuthology.orchestra.run.smithi164.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-23T18:45:30.334 INFO:teuthology.orchestra.run.smithi038.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4479-g8627af3e-1jammy [657 kB] 2023-06-23T18:45:30.494 INFO:teuthology.orchestra.run.smithi038.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4479-g8627af3e-1jammy [344 kB] 2023-06-23T18:45:30.575 INFO:teuthology.orchestra.run.smithi038.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4479-g8627af3e-1jammy [22.9 kB] 2023-06-23T18:45:30.576 INFO:teuthology.orchestra.run.smithi038.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4479-g8627af3e-1jammy [170 kB] 2023-06-23T18:45:30.586 INFO:teuthology.orchestra.run.smithi038.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4479-g8627af3e-1jammy [49.0 kB] 2023-06-23T18:45:30.588 INFO:teuthology.orchestra.run.smithi038.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4479-g8627af3e-1jammy [319 kB] 2023-06-23T18:45:30.668 INFO:teuthology.orchestra.run.smithi038.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4479-g8627af3e-1jammy [6,063 kB] 2023-06-23T18:45:30.693 INFO:teuthology.orchestra.run.smithi192.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-23T18:45:30.695 INFO:teuthology.orchestra.run.smithi192.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-23T18:45:30.698 INFO:teuthology.orchestra.run.smithi192.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-23T18:45:30.699 INFO:teuthology.orchestra.run.smithi192.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T18:45:30.700 INFO:teuthology.orchestra.run.smithi192.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi192.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-23T18:45:30.746 INFO:teuthology.orchestra.run.smithi192.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-23T18:45:30.750 INFO:teuthology.orchestra.run.smithi192.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-23T18:45:30.750 INFO:teuthology.orchestra.run.smithi192.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-23T18:45:30.805 INFO:teuthology.orchestra.run.smithi192.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-23T18:45:30.814 INFO:teuthology.orchestra.run.smithi164.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-23T18:45:30.815 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-23T18:45:30.816 INFO:teuthology.orchestra.run.smithi164.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-23T18:45:30.817 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-23T18:45:30.819 INFO:teuthology.orchestra.run.smithi164.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-23T18:45:30.820 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-23T18:45:30.820 INFO:teuthology.orchestra.run.smithi164.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T18:45:30.821 INFO:teuthology.orchestra.run.smithi164.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-23T18:45:30.821 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T18:45:30.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-23T18:45:30.823 INFO:teuthology.orchestra.run.smithi164.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-23T18:45:30.825 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-23T18:45:30.864 INFO:teuthology.orchestra.run.smithi164.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-23T18:45:30.867 INFO:teuthology.orchestra.run.smithi164.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-23T18:45:30.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-23T18:45:30.868 INFO:teuthology.orchestra.run.smithi164.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-23T18:45:30.871 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-23T18:45:30.872 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-23T18:45:30.926 INFO:teuthology.orchestra.run.smithi164.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-23T18:45:30.927 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-23T18:45:30.970 INFO:teuthology.orchestra.run.smithi192.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-23T18:45:31.029 INFO:teuthology.orchestra.run.smithi118.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4479-g8627af3e-1jammy [6,825 kB] 2023-06-23T18:45:31.037 INFO:teuthology.orchestra.run.smithi164.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4479-g8627af3e-1jammy [102 kB] 2023-06-23T18:45:31.091 INFO:teuthology.orchestra.run.smithi164.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-23T18:45:31.091 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-23T18:45:31.108 INFO:teuthology.orchestra.run.smithi164.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4479-g8627af3e-1jammy [429 kB] 2023-06-23T18:45:31.201 INFO:teuthology.orchestra.run.smithi164.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4479-g8627af3e-1jammy [22.3 MB] 2023-06-23T18:45:31.229 INFO:teuthology.orchestra.run.smithi192.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-23T18:45:31.261 INFO:teuthology.orchestra.run.smithi192.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-23T18:45:31.287 INFO:teuthology.orchestra.run.smithi192.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-23T18:45:31.341 INFO:teuthology.orchestra.run.smithi192.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-23T18:45:31.347 INFO:teuthology.orchestra.run.smithi164.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-23T18:45:31.348 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-23T18:45:31.359 INFO:teuthology.orchestra.run.smithi192.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-23T18:45:31.379 INFO:teuthology.orchestra.run.smithi164.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-23T18:45:31.380 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-23T18:45:31.387 INFO:teuthology.orchestra.run.smithi192.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-23T18:45:31.405 INFO:teuthology.orchestra.run.smithi164.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-23T18:45:31.408 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-23T18:45:31.458 INFO:teuthology.orchestra.run.smithi164.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-23T18:45:31.461 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-23T18:45:31.477 INFO:teuthology.orchestra.run.smithi164.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-23T18:45:31.479 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-23T18:45:31.505 INFO:teuthology.orchestra.run.smithi164.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-23T18:45:31.507 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-23T18:45:31.516 INFO:teuthology.orchestra.run.smithi192.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-23T18:45:31.547 INFO:teuthology.orchestra.run.smithi192.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-23T18:45:31.568 INFO:teuthology.orchestra.run.smithi192.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi192.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-23T18:45:31.635 INFO:teuthology.orchestra.run.smithi164.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-23T18:45:31.639 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-23T18:45:31.666 INFO:teuthology.orchestra.run.smithi164.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-23T18:45:31.670 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-23T18:45:31.686 INFO:teuthology.orchestra.run.smithi164.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-23T18:45:31.690 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-23T18:45:31.693 INFO:teuthology.orchestra.run.smithi164.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-23T18:45:31.697 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-23T18:45:31.752 INFO:teuthology.orchestra.run.smithi038.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4479-g8627af3e-1jammy [102 kB] 2023-06-23T18:45:31.754 INFO:teuthology.orchestra.run.smithi038.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4479-g8627af3e-1jammy [429 kB] 2023-06-23T18:45:31.779 INFO:teuthology.orchestra.run.smithi192.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-23T18:45:31.814 INFO:teuthology.orchestra.run.smithi038.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4479-g8627af3e-1jammy [22.3 MB] 2023-06-23T18:45:31.899 INFO:teuthology.orchestra.run.smithi164.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-23T18:45:31.902 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-23T18:45:31.945 INFO:teuthology.orchestra.run.smithi192.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4479-g8627af3e-1jammy [6,825 kB] 2023-06-23T18:45:32.075 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4479-g8627af3e-1jammy [6,825 kB] 2023-06-23T18:45:32.092 INFO:teuthology.orchestra.run.smithi118.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4479-g8627af3e-1jammy [226 kB] 2023-06-23T18:45:32.143 INFO:teuthology.orchestra.run.smithi118.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4479-g8627af3e-1jammy [115 kB] 2023-06-23T18:45:32.152 INFO:teuthology.orchestra.run.smithi118.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4479-g8627af3e-1jammy [1,469 kB] 2023-06-23T18:45:32.240 INFO:teuthology.orchestra.run.smithi192.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-23T18:45:32.246 INFO:teuthology.orchestra.run.smithi192.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-23T18:45:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-23T18:45:32.362 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-23T18:45:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-23T18:45:32.368 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-23T18:45:32.372 INFO:teuthology.orchestra.run.smithi192.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-23T18:45:32.389 INFO:teuthology.orchestra.run.smithi118.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4479-g8627af3e-1jammy [9,879 kB] 2023-06-23T18:45:32.419 INFO:teuthology.orchestra.run.smithi192.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-23T18:45:32.420 INFO:teuthology.orchestra.run.smithi192.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T18:45:32.425 INFO:teuthology.orchestra.run.smithi192.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-23T18:45:32.427 INFO:teuthology.orchestra.run.smithi192.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-23T18:45:32.443 INFO:teuthology.orchestra.run.smithi192.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-23T18:45:32.450 INFO:teuthology.orchestra.run.smithi192.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-23T18:45:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-23T18:45:32.494 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-23T18:45:32.511 INFO:teuthology.orchestra.run.smithi192.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-23T18:45:32.540 INFO:teuthology.orchestra.run.smithi164.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-23T18:45:32.540 INFO:teuthology.orchestra.run.smithi164.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T18:45:32.541 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-23T18:45:32.542 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T18:45:32.546 INFO:teuthology.orchestra.run.smithi164.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-23T18:45:32.548 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-23T18:45:32.548 INFO:teuthology.orchestra.run.smithi164.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-23T18:45:32.549 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-23T18:45:32.563 INFO:teuthology.orchestra.run.smithi164.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-23T18:45:32.566 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-23T18:45:32.571 INFO:teuthology.orchestra.run.smithi164.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-23T18:45:32.573 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-23T18:45:32.632 INFO:teuthology.orchestra.run.smithi164.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-23T18:45:32.633 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-23T18:45:32.661 INFO:teuthology.orchestra.run.smithi192.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4479-g8627af3e-1jammy [226 kB] 2023-06-23T18:45:32.676 INFO:teuthology.orchestra.run.smithi192.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-23T18:45:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4479-g8627af3e-1jammy [115 kB] 2023-06-23T18:45:32.701 INFO:teuthology.orchestra.run.smithi192.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4479-g8627af3e-1jammy [1,469 kB] 2023-06-23T18:45:32.796 INFO:teuthology.orchestra.run.smithi164.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-23T18:45:32.798 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-23T18:45:32.843 INFO:teuthology.orchestra.run.smithi192.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-23T18:45:32.874 INFO:teuthology.orchestra.run.smithi192.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4479-g8627af3e-1jammy [9,879 kB] 2023-06-23T18:45:32.962 INFO:teuthology.orchestra.run.smithi164.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-23T18:45:33.027 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-23T18:45:33.116 INFO:teuthology.orchestra.run.smithi192.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-23T18:45:33.142 INFO:teuthology.orchestra.run.smithi192.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-23T18:45:33.237 INFO:teuthology.orchestra.run.smithi164.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-23T18:45:33.240 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4479-g8627af3e-1jammy [226 kB] 2023-06-23T18:45:33.262 INFO:teuthology.orchestra.run.smithi164.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-23T18:45:33.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4479-g8627af3e-1jammy [115 kB] 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4479-g8627af3e-1jammy [1,469 kB] 2023-06-23T18:45:33.328 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-23T18:45:33.581 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4479-g8627af3e-1jammy [9,879 kB] 2023-06-23T18:45:34.004 INFO:teuthology.orchestra.run.smithi118.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4479-g8627af3e-1jammy [31.5 MB] 2023-06-23T18:45:34.160 INFO:teuthology.orchestra.run.smithi192.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4479-g8627af3e-1jammy [31.5 MB] 2023-06-23T18:45:35.022 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4479-g8627af3e-1jammy [31.5 MB] 2023-06-23T18:45:35.901 INFO:teuthology.orchestra.run.smithi038.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4479-g8627af3e-1jammy [6,825 kB] 2023-06-23T18:45:37.341 INFO:teuthology.orchestra.run.smithi038.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4479-g8627af3e-1jammy [226 kB] 2023-06-23T18:45:37.393 INFO:teuthology.orchestra.run.smithi038.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4479-g8627af3e-1jammy [115 kB] 2023-06-23T18:45:37.399 INFO:teuthology.orchestra.run.smithi038.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4479-g8627af3e-1jammy [1,469 kB] 2023-06-23T18:45:37.719 INFO:teuthology.orchestra.run.smithi038.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4479-g8627af3e-1jammy [9,879 kB] 2023-06-23T18:45:37.928 INFO:teuthology.orchestra.run.smithi192.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4479-g8627af3e-1jammy [3,590 B] 2023-06-23T18:45:37.928 INFO:teuthology.orchestra.run.smithi192.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4479-g8627af3e-1jammy [810 kB] 2023-06-23T18:45:37.944 INFO:teuthology.orchestra.run.smithi192.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4479-g8627af3e-1jammy [2,160 kB] 2023-06-23T18:45:38.126 INFO:teuthology.orchestra.run.smithi192.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4479-g8627af3e-1jammy [214 kB] 2023-06-23T18:45:38.150 INFO:teuthology.orchestra.run.smithi192.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4479-g8627af3e-1jammy [124 kB] 2023-06-23T18:45:38.165 INFO:teuthology.orchestra.run.smithi192.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4479-g8627af3e-1jammy [1,841 kB] 2023-06-23T18:45:38.343 INFO:teuthology.orchestra.run.smithi192.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4479-g8627af3e-1jammy [8,615 kB] 2023-06-23T18:45:38.433 INFO:teuthology.orchestra.run.smithi118.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4479-g8627af3e-1jammy [3,590 B] 2023-06-23T18:45:38.464 INFO:teuthology.orchestra.run.smithi118.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4479-g8627af3e-1jammy [810 kB] 2023-06-23T18:45:38.480 INFO:teuthology.orchestra.run.smithi118.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4479-g8627af3e-1jammy [2,160 kB] 2023-06-23T18:45:38.588 INFO:teuthology.orchestra.run.smithi118.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4479-g8627af3e-1jammy [214 kB] 2023-06-23T18:45:38.599 INFO:teuthology.orchestra.run.smithi118.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4479-g8627af3e-1jammy [124 kB] 2023-06-23T18:45:38.609 INFO:teuthology.orchestra.run.smithi164.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4479-g8627af3e-1jammy [6,825 kB] 2023-06-23T18:45:38.619 INFO:teuthology.orchestra.run.smithi118.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4479-g8627af3e-1jammy [1,841 kB] 2023-06-23T18:45:38.865 INFO:teuthology.orchestra.run.smithi118.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4479-g8627af3e-1jammy [8,615 kB] 2023-06-23T18:45:39.252 INFO:teuthology.orchestra.run.smithi192.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4479-g8627af3e-1jammy [3,720 B] 2023-06-23T18:45:39.253 INFO:teuthology.orchestra.run.smithi192.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4479-g8627af3e-1jammy [47.4 MB] 2023-06-23T18:45:39.770 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4479-g8627af3e-1jammy [3,590 B] 2023-06-23T18:45:39.771 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4479-g8627af3e-1jammy [810 kB] 2023-06-23T18:45:39.786 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4479-g8627af3e-1jammy [2,160 kB] 2023-06-23T18:45:39.813 INFO:teuthology.orchestra.run.smithi038.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4479-g8627af3e-1jammy [31.5 MB] 2023-06-23T18:45:40.008 INFO:teuthology.orchestra.run.smithi118.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4479-g8627af3e-1jammy [3,720 B] 2023-06-23T18:45:40.017 INFO:teuthology.orchestra.run.smithi118.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4479-g8627af3e-1jammy [47.4 MB] 2023-06-23T18:45:40.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4479-g8627af3e-1jammy [214 kB] 2023-06-23T18:45:40.104 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4479-g8627af3e-1jammy [124 kB] 2023-06-23T18:45:40.112 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4479-g8627af3e-1jammy [1,841 kB] 2023-06-23T18:45:40.403 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4479-g8627af3e-1jammy [8,615 kB] 2023-06-23T18:45:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4479-g8627af3e-1jammy [226 kB] 2023-06-23T18:45:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4479-g8627af3e-1jammy [115 kB] 2023-06-23T18:45:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4479-g8627af3e-1jammy [1,469 kB] 2023-06-23T18:45:41.742 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4479-g8627af3e-1jammy [3,720 B] 2023-06-23T18:45:41.743 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4479-g8627af3e-1jammy [47.4 MB] 2023-06-23T18:45:41.964 INFO:teuthology.orchestra.run.smithi164.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4479-g8627af3e-1jammy [9,879 kB] 2023-06-23T18:45:44.171 INFO:teuthology.orchestra.run.smithi192.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4479-g8627af3e-1jammy [231 kB] 2023-06-23T18:45:44.246 INFO:teuthology.orchestra.run.smithi192.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4479-g8627af3e-1jammy [217 kB] 2023-06-23T18:45:44.250 INFO:teuthology.orchestra.run.smithi192.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4479-g8627af3e-1jammy [23.8 kB] 2023-06-23T18:45:44.251 INFO:teuthology.orchestra.run.smithi192.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4479-g8627af3e-1jammy [13.2 kB] 2023-06-23T18:45:44.252 INFO:teuthology.orchestra.run.smithi192.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4479-g8627af3e-1jammy [28.3 kB] 2023-06-23T18:45:44.253 INFO:teuthology.orchestra.run.smithi192.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4479-g8627af3e-1jammy [12.0 MB] 2023-06-23T18:45:45.840 INFO:teuthology.orchestra.run.smithi192.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4479-g8627af3e-1jammy [82.1 kB] 2023-06-23T18:45:46.391 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 183 MB in 19s (9,469 kB/s) 2023-06-23T18:45:46.540 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T18:45:46.639 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165998 files and directories currently installed.) 2023-06-23T18:45:46.645 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-23T18:45:46.697 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-23T18:45:46.884 INFO:teuthology.orchestra.run.smithi164.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4479-g8627af3e-1jammy [31.5 MB] 2023-06-23T18:45:46.966 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T18:45:46.993 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-23T18:45:47.024 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:45:47.140 INFO:teuthology.orchestra.run.smithi118.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4479-g8627af3e-1jammy [231 kB] 2023-06-23T18:45:47.144 INFO:teuthology.orchestra.run.smithi118.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4479-g8627af3e-1jammy [217 kB] 2023-06-23T18:45:47.149 INFO:teuthology.orchestra.run.smithi118.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4479-g8627af3e-1jammy [23.8 kB] 2023-06-23T18:45:47.150 INFO:teuthology.orchestra.run.smithi118.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4479-g8627af3e-1jammy [13.2 kB] 2023-06-23T18:45:47.150 INFO:teuthology.orchestra.run.smithi118.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4479-g8627af3e-1jammy [28.3 kB] 2023-06-23T18:45:47.151 INFO:teuthology.orchestra.run.smithi118.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4479-g8627af3e-1jammy [12.0 MB] 2023-06-23T18:45:47.335 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T18:45:47.362 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-23T18:45:47.402 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-23T18:45:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4479-g8627af3e-1jammy [3,590 B] 2023-06-23T18:45:47.455 INFO:teuthology.orchestra.run.smithi038.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4479-g8627af3e-1jammy [810 kB] 2023-06-23T18:45:47.471 INFO:teuthology.orchestra.run.smithi038.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4479-g8627af3e-1jammy [2,160 kB] 2023-06-23T18:45:47.734 INFO:teuthology.orchestra.run.smithi038.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4479-g8627af3e-1jammy [214 kB] 2023-06-23T18:45:47.738 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-23T18:45:47.763 INFO:teuthology.orchestra.run.smithi038.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4479-g8627af3e-1jammy [124 kB] 2023-06-23T18:45:47.765 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-23T18:45:47.772 INFO:teuthology.orchestra.run.smithi038.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4479-g8627af3e-1jammy [1,841 kB] 2023-06-23T18:45:47.847 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:45:47.955 INFO:teuthology.orchestra.run.smithi118.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4479-g8627af3e-1jammy [82.1 kB] 2023-06-23T18:45:47.982 INFO:teuthology.orchestra.run.smithi038.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4479-g8627af3e-1jammy [8,615 kB] 2023-06-23T18:45:48.183 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-23T18:45:48.210 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-23T18:45:48.250 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:45:48.497 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 183 MB in 21s (8,560 kB/s) 2023-06-23T18:45:48.578 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T18:45:48.604 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-23T18:45:48.614 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T18:45:48.636 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:45:48.651 INFO:teuthology.orchestra.run.smithi038.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4479-g8627af3e-1jammy [3,720 B] 2023-06-23T18:45:48.651 INFO:teuthology.orchestra.run.smithi038.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4479-g8627af3e-1jammy [47.4 MB] 2023-06-23T18:45:48.710 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165998 files and directories currently installed.) 2023-06-23T18:45:48.715 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-23T18:45:48.782 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-23T18:45:49.140 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T18:45:49.166 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-23T18:45:49.189 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T18:45:49.207 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:45:49.216 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-23T18:45:49.256 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:45:49.305 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4479-g8627af3e-1jammy [231 kB] 2023-06-23T18:45:49.383 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4479-g8627af3e-1jammy [217 kB] 2023-06-23T18:45:49.387 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4479-g8627af3e-1jammy [23.8 kB] 2023-06-23T18:45:49.388 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4479-g8627af3e-1jammy [13.2 kB] 2023-06-23T18:45:49.389 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4479-g8627af3e-1jammy [28.3 kB] 2023-06-23T18:45:49.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4479-g8627af3e-1jammy [12.0 MB] 2023-06-23T18:45:49.560 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T18:45:49.586 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-23T18:45:49.626 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-23T18:45:49.693 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T18:45:49.719 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:49.768 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:49.963 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-23T18:45:49.989 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-23T18:45:50.063 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:45:50.287 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T18:45:50.314 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:50.344 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4479-g8627af3e-1jammy [82.1 kB] 2023-06-23T18:45:50.345 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:50.375 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-23T18:45:50.401 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-23T18:45:50.441 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:45:50.674 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T18:45:50.700 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:50.740 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:50.761 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T18:45:50.788 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-23T18:45:50.828 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:45:50.893 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 183 MB in 24s (7,708 kB/s) 2023-06-23T18:45:51.026 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T18:45:51.085 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-23T18:45:51.112 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-23T18:45:51.115 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165998 files and directories currently installed.) 2023-06-23T18:45:51.120 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-23T18:45:51.148 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T18:45:51.151 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:45:51.158 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-23T18:45:51.174 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-23T18:45:51.214 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:45:51.447 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librados2. 2023-06-23T18:45:51.453 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T18:45:51.472 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../011-librados2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:51.479 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-23T18:45:51.501 INFO:teuthology.orchestra.run.smithi038.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4479-g8627af3e-1jammy [231 kB] 2023-06-23T18:45:51.512 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:51.519 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:45:51.571 INFO:teuthology.orchestra.run.smithi038.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4479-g8627af3e-1jammy [217 kB] 2023-06-23T18:45:51.576 INFO:teuthology.orchestra.run.smithi038.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4479-g8627af3e-1jammy [23.8 kB] 2023-06-23T18:45:51.576 INFO:teuthology.orchestra.run.smithi038.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4479-g8627af3e-1jammy [13.2 kB] 2023-06-23T18:45:51.577 INFO:teuthology.orchestra.run.smithi038.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4479-g8627af3e-1jammy [28.3 kB] 2023-06-23T18:45:51.578 INFO:teuthology.orchestra.run.smithi038.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4479-g8627af3e-1jammy [12.0 MB] 2023-06-23T18:45:51.659 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T18:45:51.686 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:51.734 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:51.823 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T18:45:51.849 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-23T18:45:51.881 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-23T18:45:51.940 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librbd1. 2023-06-23T18:45:51.954 INFO:teuthology.orchestra.run.smithi038.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4479-g8627af3e-1jammy [82.1 kB] 2023-06-23T18:45:51.967 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../012-librbd1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:52.007 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:52.121 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T18:45:52.148 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:52.159 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-23T18:45:52.179 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:52.185 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-23T18:45:52.259 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:45:52.452 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T18:45:52.478 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:52.524 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T18:45:52.535 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 183 MB in 25s (7,268 kB/s) 2023-06-23T18:45:52.551 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:52.591 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:52.604 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-23T18:45:52.630 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-23T18:45:52.670 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:45:52.674 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T18:45:52.768 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165998 files and directories currently installed.) 2023-06-23T18:45:52.774 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-23T18:45:52.814 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-23T18:45:52.820 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rados. 2023-06-23T18:45:52.847 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:52.848 INFO:teuthology.orchestra.run.smithi164.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4479-g8627af3e-1jammy [3,590 B] 2023-06-23T18:45:52.848 INFO:teuthology.orchestra.run.smithi164.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4479-g8627af3e-1jammy [810 kB] 2023-06-23T18:45:52.863 INFO:teuthology.orchestra.run.smithi164.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4479-g8627af3e-1jammy [2,160 kB] 2023-06-23T18:45:52.887 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:52.944 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-23T18:45:52.971 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-23T18:45:53.007 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T18:45:53.010 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:45:53.033 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-23T18:45:53.073 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:45:53.117 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T18:45:53.144 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-23T18:45:53.146 INFO:teuthology.orchestra.run.smithi164.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4479-g8627af3e-1jammy [214 kB] 2023-06-23T18:45:53.160 INFO:teuthology.orchestra.run.smithi164.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4479-g8627af3e-1jammy [124 kB] 2023-06-23T18:45:53.181 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T18:45:53.183 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:45:53.184 INFO:teuthology.orchestra.run.smithi164.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4479-g8627af3e-1jammy [1,841 kB] 2023-06-23T18:45:53.208 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:53.248 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:53.298 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librados2. 2023-06-23T18:45:53.313 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../011-librados2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:53.347 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:53.419 INFO:teuthology.orchestra.run.smithi164.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4479-g8627af3e-1jammy [8,615 kB] 2023-06-23T18:45:53.500 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T18:45:53.527 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:53.535 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T18:45:53.561 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-23T18:45:53.567 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:53.593 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:45:53.820 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T18:45:53.847 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-23T18:45:53.853 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T18:45:53.880 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:53.886 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-23T18:45:53.919 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:53.933 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librbd1. 2023-06-23T18:45:53.960 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../012-librbd1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:54.000 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:54.047 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T18:45:54.073 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:54.121 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:54.231 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-23T18:45:54.256 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T18:45:54.258 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-23T18:45:54.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-23T18:45:54.323 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-23T18:45:54.331 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:45:54.436 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T18:45:54.463 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:54.473 INFO:teuthology.orchestra.run.smithi164.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4479-g8627af3e-1jammy [3,720 B] 2023-06-23T18:45:54.474 INFO:teuthology.orchestra.run.smithi164.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4479-g8627af3e-1jammy [47.4 MB] 2023-06-23T18:45:54.502 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:54.542 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T18:45:54.542 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T18:45:54.557 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:54.568 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:54.592 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:54.608 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:54.643 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-23T18:45:54.670 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-23T18:45:54.709 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:45:54.764 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rados. 2023-06-23T18:45:54.779 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:54.814 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:54.886 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T18:45:54.903 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T18:45:54.913 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-23T18:45:54.930 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:54.944 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:45:54.961 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:55.054 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T18:45:55.081 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-23T18:45:55.108 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T18:45:55.121 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:45:55.135 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:55.175 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:55.266 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librgw2. 2023-06-23T18:45:55.293 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../021-librgw2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:55.298 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-23T18:45:55.324 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-23T18:45:55.364 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:45:55.415 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:55.428 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T18:45:55.454 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:55.527 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:55.527 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T18:45:55.527 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-23T18:45:55.527 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:45:55.717 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2023-06-23T18:45:55.744 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librados2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:55.784 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:55.806 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T18:45:55.832 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:55.872 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:55.877 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T18:45:55.905 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:55.935 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T18:45:55.944 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:55.950 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:55.985 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:56.158 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T18:45:56.174 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-23T18:45:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2023-06-23T18:45:56.208 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-23T18:45:56.210 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-librbd1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:56.245 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:56.254 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-23T18:45:56.281 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-23T18:45:56.321 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:45:56.347 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T18:45:56.374 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:56.414 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:56.469 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T18:45:56.496 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:56.536 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:56.648 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T18:45:56.649 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T18:45:56.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:56.675 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:56.732 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:56.759 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T18:45:56.786 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:45:56.825 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:45:56.898 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T18:45:56.924 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-23T18:45:56.964 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:45:56.992 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2023-06-23T18:45:57.008 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.050 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.120 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-23T18:45:57.147 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-23T18:45:57.169 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-common. 2023-06-23T18:45:57.186 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:45:57.196 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.235 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.284 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librgw2. 2023-06-23T18:45:57.310 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../021-librgw2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.350 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T18:45:57.396 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.506 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librados2. 2023-06-23T18:45:57.533 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../011-librados2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.589 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T18:45:57.646 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:57.845 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T18:45:57.871 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:57.911 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.000 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T18:45:58.026 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:58.034 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librbd1. 2023-06-23T18:45:58.061 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../012-librbd1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.067 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.101 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.265 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-23T18:45:58.291 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-23T18:45:58.331 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:45:58.412 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T18:45:58.433 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-base. 2023-06-23T18:45:58.438 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-23T18:45:58.459 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-23T18:45:58.500 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.512 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T18:45:58.528 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.562 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.617 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T18:45:58.643 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.684 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.748 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T18:45:58.774 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.814 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:58.839 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rados. 2023-06-23T18:45:58.855 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:58.897 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:59.129 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-23T18:45:59.155 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-23T18:45:59.179 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-common. 2023-06-23T18:45:59.206 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:45:59.246 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:59.579 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:45:59.743 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T18:45:59.769 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-23T18:45:59.817 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:45:59.843 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T18:45:59.870 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:45:59.909 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:45:59.995 INFO:teuthology.orchestra.run.smithi164.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4479-g8627af3e-1jammy [231 kB] 2023-06-23T18:46:00.070 INFO:teuthology.orchestra.run.smithi164.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4479-g8627af3e-1jammy [217 kB] 2023-06-23T18:46:00.075 INFO:teuthology.orchestra.run.smithi164.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4479-g8627af3e-1jammy [23.8 kB] 2023-06-23T18:46:00.076 INFO:teuthology.orchestra.run.smithi164.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4479-g8627af3e-1jammy [13.2 kB] 2023-06-23T18:46:00.077 INFO:teuthology.orchestra.run.smithi164.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4479-g8627af3e-1jammy [28.3 kB] 2023-06-23T18:46:00.078 INFO:teuthology.orchestra.run.smithi164.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4479-g8627af3e-1jammy [12.0 MB] 2023-06-23T18:46:00.137 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T18:46:00.146 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2023-06-23T18:46:00.150 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:00.172 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-librgw2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:00.179 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:00.212 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:00.348 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cheroot. 2023-06-23T18:46:00.375 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-23T18:46:00.415 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:00.490 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T18:46:00.517 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:00.556 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:00.558 INFO:teuthology.orchestra.run.smithi164.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4479-g8627af3e-1jammy [82.1 kB] 2023-06-23T18:46:00.731 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T18:46:00.743 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-23T18:46:00.747 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:00.765 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-23T18:46:00.790 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:00.801 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:00.834 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T18:46:00.862 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-23T18:46:00.892 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-23T18:46:01.054 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-23T18:46:01.080 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-23T18:46:01.093 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-23T18:46:01.093 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-base. 2023-06-23T18:46:01.102 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 183 MB in 34s (5,384 kB/s) 2023-06-23T18:46:01.119 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-23T18:46:01.120 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:01.120 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:01.159 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:01.162 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T18:46:01.169 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:01.178 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:01.220 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:01.242 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T18:46:01.312 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165998 files and directories currently installed.) 2023-06-23T18:46:01.318 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-23T18:46:01.365 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-23T18:46:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-23T18:46:01.446 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T18:46:01.450 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-23T18:46:01.472 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:01.490 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:01.512 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:01.565 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T18:46:01.591 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-23T18:46:01.631 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:46:01.659 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T18:46:01.685 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-23T18:46:01.726 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:46:01.793 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempora. 2023-06-23T18:46:01.820 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-23T18:46:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-23T18:46:01.859 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-23T18:46:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-23T18:46:01.917 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package librgw2. 2023-06-23T18:46:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:01.933 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../021-librgw2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:01.940 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2023-06-23T18:46:01.966 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:01.967 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:02.007 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:02.012 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T18:46:02.038 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-23T18:46:02.070 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-23T18:46:02.120 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-portend. 2023-06-23T18:46:02.147 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-23T18:46:02.179 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-23T18:46:02.201 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cheroot. 2023-06-23T18:46:02.216 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-23T18:46:02.251 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:02.331 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-23T18:46:02.347 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-23T18:46:02.415 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:46:02.437 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T18:46:02.453 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:02.465 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-23T18:46:02.486 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:02.492 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-23T18:46:02.531 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:02.537 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-23T18:46:02.564 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-23T18:46:02.629 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:02.760 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-23T18:46:02.786 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-23T18:46:02.814 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-23T18:46:02.826 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:46:02.835 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T18:46:02.842 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-23T18:46:02.861 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-23T18:46:02.881 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:02.901 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:46:02.907 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-23T18:46:02.934 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-23T18:46:02.974 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:03.188 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T18:46:03.201 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T18:46:03.215 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-23T18:46:03.221 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T18:46:03.228 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:03.248 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-23T18:46:03.255 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:03.263 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2023-06-23T18:46:03.267 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:03.276 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-23T18:46:03.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-23T18:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:03.303 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-23T18:46:03.339 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:03.343 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:03.524 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T18:46:03.551 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:03.583 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:46:03.587 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-common. 2023-06-23T18:46:03.599 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T18:46:03.614 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:03.615 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-23T18:46:03.621 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempora. 2023-06-23T18:46:03.645 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:03.647 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-23T18:46:03.658 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-23T18:46:03.680 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-23T18:46:03.960 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T18:46:03.987 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-23T18:46:04.019 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T18:46:04.027 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:04.046 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:46:04.095 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:04.124 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-portend. 2023-06-23T18:46:04.134 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-23T18:46:04.150 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-23T18:46:04.160 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-23T18:46:04.191 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-23T18:46:04.191 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:04.313 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-mako. 2023-06-23T18:46:04.339 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-23T18:46:04.371 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:04.477 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-23T18:46:04.478 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2023-06-23T18:46:04.503 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-23T18:46:04.504 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-23T18:46:04.514 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T18:46:04.541 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:46:04.543 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:04.544 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:04.581 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:04.700 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T18:46:04.726 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T18:46:04.766 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:04.847 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T18:46:04.873 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-23T18:46:04.873 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-23T18:46:04.899 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-23T18:46:04.901 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T18:46:04.913 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:46:04.927 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-23T18:46:04.939 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:04.943 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-base. 2023-06-23T18:46:04.959 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:04.971 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:05.019 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:05.069 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T18:46:05.095 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-23T18:46:05.135 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:05.242 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-23T18:46:05.267 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T18:46:05.268 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-23T18:46:05.293 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-23T18:46:05.304 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-23T18:46:05.308 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:05.330 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-23T18:46:05.333 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-23T18:46:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:46:05.438 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webob. 2023-06-23T18:46:05.464 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-23T18:46:05.505 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:05.562 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-23T18:46:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-23T18:46:05.628 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:05.645 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T18:46:05.671 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-23T18:46:05.699 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librados2. 2023-06-23T18:46:05.711 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-23T18:46:05.726 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../011-librados2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:05.756 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-23T18:46:05.782 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:05.783 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-23T18:46:05.822 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:05.824 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T18:46:05.851 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-23T18:46:05.894 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:05.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2023-06-23T18:46:05.929 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-23T18:46:05.972 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-23T18:46:05.998 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T18:46:06.024 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-23T18:46:06.056 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:06.092 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cheroot. 2023-06-23T18:46:06.119 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-23T18:46:06.150 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:06.202 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T18:46:06.229 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-23T18:46:06.269 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:06.275 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2023-06-23T18:46:06.302 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-23T18:46:06.326 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-mako. 2023-06-23T18:46:06.342 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-23T18:46:06.343 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librbd1. 2023-06-23T18:46:06.352 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-23T18:46:06.358 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../012-librbd1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:06.392 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:06.393 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:06.411 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-23T18:46:06.424 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-23T18:46:06.461 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:06.572 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-paste. 2023-06-23T18:46:06.587 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-23T18:46:06.603 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-23T18:46:06.618 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-23T18:46:06.630 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:06.653 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:06.730 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T18:46:06.748 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-23T18:46:06.756 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T18:46:06.775 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-23T18:46:06.796 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T18:46:06.814 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:06.831 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:06.871 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:06.933 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T18:46:06.940 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T18:46:06.948 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-23T18:46:06.966 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-23T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:07.006 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:46:07.124 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T18:46:07.126 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-23T18:46:07.150 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-23T18:46:07.153 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-23T18:46:07.157 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rados. 2023-06-23T18:46:07.172 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:07.190 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:07.192 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:07.215 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:07.294 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T18:46:07.321 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-23T18:46:07.326 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T18:46:07.352 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-23T18:46:07.360 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:46:07.392 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-23T18:46:07.451 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webob. 2023-06-23T18:46:07.454 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-tempora. 2023-06-23T18:46:07.469 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-23T18:46:07.477 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-23T18:46:07.503 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-23T18:46:07.509 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:07.535 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T18:46:07.561 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:07.601 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:07.646 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T18:46:07.661 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-23T18:46:07.664 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T18:46:07.690 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-23T18:46:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-23T18:46:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-23T18:46:07.765 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-portend. 2023-06-23T18:46:07.792 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-23T18:46:07.821 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T18:46:07.830 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T18:46:07.831 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-23T18:46:07.847 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:07.856 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-23T18:46:07.879 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:07.891 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:08.016 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T18:46:08.032 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-23T18:46:08.040 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T18:46:08.066 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:46:08.067 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-23T18:46:08.107 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:08.136 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-23T18:46:08.163 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-23T18:46:08.183 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T18:46:08.203 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:08.209 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-23T18:46:08.223 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T18:46:08.249 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:08.250 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:08.290 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:08.410 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2023-06-23T18:46:08.413 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-certifi. 2023-06-23T18:46:08.436 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-23T18:46:08.439 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-23T18:46:08.471 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:08.476 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:08.506 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T18:46:08.533 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-23T18:46:08.552 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-paste. 2023-06-23T18:46:08.564 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:46:08.578 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-23T18:46:08.601 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T18:46:08.618 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:08.628 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-23T18:46:08.668 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-23T18:46:08.741 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-idna. 2023-06-23T18:46:08.767 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-23T18:46:08.797 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T18:46:08.807 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-23T18:46:08.823 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T18:46:08.863 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:08.910 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T18:46:08.929 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T18:46:08.937 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-23T18:46:08.944 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:08.947 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T18:46:08.964 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-23T18:46:08.976 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-23T18:46:08.979 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:09.005 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:09.127 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-urllib3. 2023-06-23T18:46:09.153 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-23T18:46:09.193 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:09.258 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T18:46:09.271 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T18:46:09.273 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-23T18:46:09.287 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-23T18:46:09.307 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T18:46:09.316 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:09.317 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T18:46:09.329 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-23T18:46:09.333 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-23T18:46:09.344 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-23T18:46:09.373 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:46:09.383 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:46:09.513 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests. 2023-06-23T18:46:09.539 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-06-23T18:46:09.579 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:46:09.599 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T18:46:09.602 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2023-06-23T18:46:09.626 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-23T18:46:09.628 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-23T18:46:09.665 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:09.668 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:09.686 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T18:46:09.710 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librgw2. 2023-06-23T18:46:09.713 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-23T18:46:09.736 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../021-librgw2_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:09.753 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-23T18:46:09.776 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:09.994 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-mako. 2023-06-23T18:46:10.012 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-23T18:46:10.022 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T18:46:10.040 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T18:46:10.040 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T18:46:10.048 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-23T18:46:10.052 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:10.066 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-23T18:46:10.068 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-23T18:46:10.092 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:10.098 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:46:10.107 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:10.304 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T18:46:10.324 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T18:46:10.330 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:10.351 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-23T18:46:10.379 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:10.380 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T18:46:10.391 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:10.402 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T18:46:10.408 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T18:46:10.411 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-certifi. 2023-06-23T18:46:10.427 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-23T18:46:10.429 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:10.446 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:10.460 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:10.460 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:10.648 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-23T18:46:10.664 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-23T18:46:10.698 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:10.719 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2023-06-23T18:46:10.725 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T18:46:10.745 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-23T18:46:10.752 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-23T18:46:10.783 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:10.789 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-idna. 2023-06-23T18:46:10.802 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:10.816 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-23T18:46:10.832 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T18:46:10.856 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-23T18:46:10.859 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:10.898 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:11.018 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T18:46:11.045 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:11.053 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-webob. 2023-06-23T18:46:11.080 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-23T18:46:11.084 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:11.089 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T18:46:11.104 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-23T18:46:11.119 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:11.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:11.175 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-urllib3. 2023-06-23T18:46:11.184 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T18:46:11.200 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-23T18:46:11.202 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-23T18:46:11.234 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-23T18:46:11.242 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:11.433 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T18:46:11.439 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T18:46:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-23T18:46:11.466 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-23T18:46:11.500 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:46:11.508 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:11.537 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T18:46:11.564 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:11.595 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests. 2023-06-23T18:46:11.612 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:11.621 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-06-23T18:46:11.661 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:46:11.671 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-common. 2023-06-23T18:46:11.698 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:11.738 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:11.811 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T18:46:11.817 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T18:46:11.838 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-23T18:46:11.844 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-23T18:46:11.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-23T18:46:11.900 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:11.982 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T18:46:12.008 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-23T18:46:12.015 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T18:46:12.042 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:12.048 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:12.081 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:12.170 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-paste. 2023-06-23T18:46:12.197 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-23T18:46:12.198 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T18:46:12.224 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-23T18:46:12.236 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:12.264 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:46:12.318 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T18:46:12.344 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:12.384 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:12.556 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T18:46:12.573 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-23T18:46:12.602 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2023-06-23T18:46:12.615 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:12.629 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-23T18:46:12.669 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:12.756 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T18:46:12.783 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:12.822 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:12.868 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T18:46:12.894 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-23T18:46:12.934 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:46:12.960 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T18:46:12.972 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2023-06-23T18:46:12.988 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:12.998 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-23T18:46:13.018 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:13.038 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-23T18:46:13.110 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-base. 2023-06-23T18:46:13.134 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T18:46:13.137 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:13.161 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-23T18:46:13.194 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:13.200 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-23T18:46:13.237 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T18:46:13.254 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-23T18:46:13.295 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-23T18:46:13.358 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2023-06-23T18:46:13.373 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-23T18:46:13.416 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:13.503 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T18:46:13.531 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:13.570 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:13.719 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2023-06-23T18:46:13.723 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T18:46:13.746 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-06-23T18:46:13.751 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-23T18:46:13.786 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:46:13.790 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:46:13.873 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-23T18:46:13.900 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-23T18:46:13.931 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:13.932 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T18:46:13.959 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:13.998 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:14.154 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-certifi. 2023-06-23T18:46:14.159 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T18:46:14.181 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-23T18:46:14.186 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-23T18:46:14.200 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cheroot. 2023-06-23T18:46:14.220 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:14.227 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-23T18:46:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:14.280 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:14.523 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-idna. 2023-06-23T18:46:14.550 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-23T18:46:14.553 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-23T18:46:14.580 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-23T18:46:14.581 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-23T18:46:14.583 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T18:46:14.610 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:14.628 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:14.650 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:14.847 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph. 2023-06-23T18:46:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-urllib3. 2023-06-23T18:46:14.874 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../061-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:14.895 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-23T18:46:14.913 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:14.932 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-23T18:46:14.934 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:14.958 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-23T18:46:14.998 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:15.011 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T18:46:15.037 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:15.072 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T18:46:15.077 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:15.099 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:15.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T18:46:15.246 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-requests. 2023-06-23T18:46:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:15.273 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-06-23T18:46:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:15.313 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:46:15.326 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-23T18:46:15.352 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-23T18:46:15.393 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:15.458 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T18:46:15.485 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-23T18:46:15.525 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-23T18:46:15.607 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T18:46:15.619 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T18:46:15.635 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-23T18:46:15.636 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:15.666 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:15.669 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:15.670 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempora. 2023-06-23T18:46:15.697 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-23T18:46:15.737 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-23T18:46:15.853 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T18:46:15.879 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:15.944 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T18:46:15.999 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:16.010 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.015 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-portend. 2023-06-23T18:46:16.042 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-23T18:46:16.064 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephadm. 2023-06-23T18:46:16.069 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.082 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-23T18:46:16.091 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../064-cephadm_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:16.130 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.374 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T18:46:16.393 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-23T18:46:16.401 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:16.419 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-23T18:46:16.431 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T18:46:16.440 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.442 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-23T18:46:16.458 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:16.459 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:16.469 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-23T18:46:16.489 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.508 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:16.727 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T18:46:16.744 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-23T18:46:16.771 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T18:46:16.776 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-23T18:46:16.797 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-23T18:46:16.837 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:46:16.897 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph. 2023-06-23T18:46:16.913 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../061-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:16.947 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:16.970 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-23T18:46:16.997 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:17.036 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:17.113 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T18:46:17.141 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:17.180 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:17.239 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T18:46:17.265 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-23T18:46:17.275 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T18:46:17.302 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:17.342 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:17.391 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-23T18:46:17.418 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T18:46:17.444 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:17.484 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:17.575 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T18:46:17.602 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:17.641 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:17.703 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T18:46:17.712 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T18:46:17.730 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-23T18:46:17.738 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:17.769 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-23T18:46:17.778 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:18.058 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-babel. 2023-06-23T18:46:18.072 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T18:46:18.085 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:18.099 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-23T18:46:18.124 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:18.139 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:18.159 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephadm. 2023-06-23T18:46:18.185 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../064-cephadm_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:18.225 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:18.400 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-mako. 2023-06-23T18:46:18.415 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-23T18:46:18.444 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T18:46:18.450 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:18.460 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-23T18:46:18.502 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-23T18:46:18.537 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-23T18:46:18.563 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-23T18:46:18.603 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:18.753 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T18:46:18.754 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T18:46:18.780 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T18:46:18.781 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:18.820 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:18.847 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T18:46:18.874 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:18.914 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:18.914 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-23T18:46:18.930 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:18.973 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:19.090 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T18:46:19.116 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-23T18:46:19.156 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:19.234 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T18:46:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-23T18:46:19.298 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2023-06-23T18:46:19.300 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:19.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:19.348 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:19.459 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webob. 2023-06-23T18:46:19.485 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-23T18:46:19.525 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:19.603 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T18:46:19.630 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T18:46:19.651 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T18:46:19.678 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:19.686 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:19.717 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T18:46:19.904 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-23T18:46:19.948 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:19.964 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-routes. 2023-06-23T18:46:19.991 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-23T18:46:20.031 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:20.071 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-babel. 2023-06-23T18:46:20.096 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T18:46:20.098 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:20.123 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:20.137 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:20.162 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:20.248 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T18:46:20.275 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-23T18:46:20.314 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:20.351 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T18:46:20.378 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:20.441 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T18:46:20.443 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:20.467 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-23T18:46:20.507 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-23T18:46:20.591 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2023-06-23T18:46:20.617 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-paste. 2023-06-23T18:46:20.618 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-cephadm_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:20.644 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-23T18:46:20.649 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:20.684 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:20.790 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph. 2023-06-23T18:46:20.806 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../061-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:20.840 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:20.844 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T18:46:20.846 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-23T18:46:20.871 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:20.873 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-23T18:46:20.910 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:20.912 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:20.952 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-23T18:46:20.978 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-23T18:46:20.987 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T18:46:21.014 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-23T18:46:21.018 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:21.053 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:21.143 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T18:46:21.170 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:21.209 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:21.272 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T18:46:21.299 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-23T18:46:21.338 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-23T18:46:21.339 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:21.353 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:21.356 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T18:46:21.384 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-23T18:46:21.391 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T18:46:21.396 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:21.418 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-23T18:46:21.423 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:46:21.458 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:21.563 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T18:46:21.590 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:21.592 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T18:46:21.619 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T18:46:21.629 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:21.659 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:21.812 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-23T18:46:21.839 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-23T18:46:21.878 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:21.962 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-routes. 2023-06-23T18:46:21.968 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T18:46:21.974 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package cephadm. 2023-06-23T18:46:21.989 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-23T18:46:21.994 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-23T18:46:22.001 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../064-cephadm_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:22.029 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:22.032 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:22.034 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-23T18:46:22.181 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T18:46:22.208 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-23T18:46:22.247 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:22.335 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-23T18:46:22.337 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T18:46:22.363 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-23T18:46:22.363 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-23T18:46:22.374 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T18:46:22.395 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:46:22.401 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:22.402 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:22.441 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:22.460 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2023-06-23T18:46:22.487 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:22.526 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:22.705 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-23T18:46:22.722 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:22.734 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-certifi. 2023-06-23T18:46:22.760 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-23T18:46:22.763 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:22.792 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:22.811 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-23T18:46:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-23T18:46:22.855 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T18:46:22.861 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:22.881 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-23T18:46:22.921 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-23T18:46:22.973 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T18:46:23.001 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:23.039 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:23.103 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-idna. 2023-06-23T18:46:23.130 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-23T18:46:23.170 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-23T18:46:23.250 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T18:46:23.276 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:23.316 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:23.356 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T18:46:23.383 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-23T18:46:23.423 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:23.473 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-urllib3. 2023-06-23T18:46:23.499 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-23T18:46:23.539 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:23.661 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T18:46:23.688 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-23T18:46:23.728 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:23.769 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-23T18:46:23.785 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-babel. 2023-06-23T18:46:23.796 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-23T18:46:23.813 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:23.835 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:23.852 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:23.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests. 2023-06-23T18:46:23.894 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-06-23T18:46:23.934 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:46:24.009 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T18:46:24.014 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T18:46:24.036 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-23T18:46:24.041 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T18:46:24.072 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:24.076 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:24.088 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T18:46:24.115 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-23T18:46:24.155 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:24.181 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T18:46:24.208 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-23T18:46:24.245 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T18:46:24.247 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-23T18:46:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-23T18:46:24.312 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:24.378 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T18:46:24.406 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-23T18:46:24.445 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:24.528 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2023-06-23T18:46:24.555 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-23T18:46:24.598 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T18:46:24.614 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:24.617 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:24.617 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T18:46:24.644 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:24.656 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:24.683 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:24.756 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T18:46:24.784 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-23T18:46:24.823 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:46:24.839 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T18:46:24.867 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:24.906 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:24.945 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T18:46:24.972 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:25.012 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:25.020 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T18:46:25.035 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:25.037 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T18:46:25.065 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-23T18:46:25.069 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:25.104 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:25.326 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T18:46:25.353 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-23T18:46:25.356 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T18:46:25.383 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-23T18:46:25.384 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-23T18:46:25.390 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T18:46:25.417 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T18:46:25.422 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-23T18:46:25.448 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:25.449 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-23T18:46:25.476 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-23T18:46:25.515 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:25.748 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T18:46:25.751 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-routes. 2023-06-23T18:46:25.775 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-23T18:46:25.775 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T18:46:25.779 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-23T18:46:25.803 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:25.814 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-23T18:46:25.818 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:25.867 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:25.868 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T18:46:25.895 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-23T18:46:25.926 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:25.944 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T18:46:25.971 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-23T18:46:26.002 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:26.134 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T18:46:26.155 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T18:46:26.162 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-23T18:46:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:26.201 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:46:26.204 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T18:46:26.221 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:26.231 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-23T18:46:26.237 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T18:46:26.264 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:26.270 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:26.304 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-23T18:46:26.375 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-23T18:46:26.423 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:26.487 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T18:46:26.514 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-23T18:46:26.553 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-23T18:46:26.624 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T18:46:26.651 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-23T18:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-23T18:46:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:46:26.692 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T18:46:26.711 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-23T18:46:26.719 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-23T18:46:26.750 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:26.759 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:26.848 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T18:46:26.875 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-23T18:46:26.906 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:46:27.002 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T18:46:27.029 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-23T18:46:27.068 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-23T18:46:27.243 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T18:46:27.245 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T18:46:27.269 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:27.273 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-23T18:46:27.309 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:27.312 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:27.466 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T18:46:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T18:46:27.493 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-23T18:46:27.495 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:27.533 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-23T18:46:27.534 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:27.562 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T18:46:27.578 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:27.620 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:27.649 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-23T18:46:27.676 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-23T18:46:27.707 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:27.803 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T18:46:27.830 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-23T18:46:27.861 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:46:27.890 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T18:46:27.917 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-23T18:46:27.948 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:27.977 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T18:46:28.004 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-23T18:46:28.044 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:28.181 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T18:46:28.208 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-23T18:46:28.247 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-23T18:46:28.276 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T18:46:28.303 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:28.342 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:28.529 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T18:46:28.543 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T18:46:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-23T18:46:28.570 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-23T18:46:28.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:28.595 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package jq. 2023-06-23T18:46:28.609 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:46:28.619 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:28.662 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-23T18:46:28.769 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T18:46:28.798 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:28.836 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:28.874 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T18:46:28.901 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-23T18:46:28.906 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package socat. 2023-06-23T18:46:28.922 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-23T18:46:28.940 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:28.956 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:29.179 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph. 2023-06-23T18:46:29.195 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../061-ceph_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:29.217 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T18:46:29.229 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:29.233 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-23T18:46:29.252 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T18:46:29.275 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:29.279 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-23T18:46:29.318 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:46:29.357 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T18:46:29.373 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:29.407 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:29.582 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T18:46:29.604 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-test. 2023-06-23T18:46:29.609 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:29.620 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T18:46:29.648 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:29.657 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-23T18:46:29.663 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:29.696 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-23T18:46:29.710 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T18:46:29.737 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-23T18:46:29.776 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:30.006 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T18:46:30.010 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T18:46:30.034 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-23T18:46:30.037 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:30.076 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:30.097 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:30.110 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T18:46:30.137 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-23T18:46:30.176 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-23T18:46:30.347 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T18:46:30.367 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T18:46:30.374 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:30.384 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-23T18:46:30.413 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:30.417 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:30.446 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephadm. 2023-06-23T18:46:30.473 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../064-cephadm_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:30.497 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T18:46:30.504 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:30.524 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-23T18:46:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:46:30.649 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package jq. 2023-06-23T18:46:30.665 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:30.696 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T18:46:30.699 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-23T18:46:30.723 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-23T18:46:30.762 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:46:30.824 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-23T18:46:30.850 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-23T18:46:30.883 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T18:46:30.890 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:30.910 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-23T18:46:30.936 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package socat. 2023-06-23T18:46:30.949 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-23T18:46:30.963 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-23T18:46:31.002 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:31.040 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T18:46:31.068 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-23T18:46:31.107 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-23T18:46:31.185 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-23T18:46:31.200 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:31.243 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:31.270 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T18:46:31.297 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-23T18:46:31.348 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:46:31.349 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T18:46:31.349 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-23T18:46:31.372 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:31.529 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T18:46:31.557 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-23T18:46:31.595 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-23T18:46:31.744 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-test. 2023-06-23T18:46:31.760 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:31.802 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:31.841 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T18:46:31.857 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:31.891 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:31.899 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T18:46:31.915 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-23T18:46:31.949 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:46:32.017 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T18:46:32.033 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:32.075 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T18:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-23T18:46:32.276 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-23T18:46:32.280 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T18:46:32.307 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:32.347 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:32.395 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T18:46:32.422 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-23T18:46:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-babel. 2023-06-23T18:46:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-23T18:46:32.461 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:32.489 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:32.580 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T18:46:32.608 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-23T18:46:32.641 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T18:46:32.647 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:46:32.668 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-23T18:46:32.707 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-23T18:46:32.768 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T18:46:32.794 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-23T18:46:32.806 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T18:46:32.833 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:32.851 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-23T18:46:32.872 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:32.919 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T18:46:32.934 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:32.969 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:33.117 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2023-06-23T18:46:33.133 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:33.175 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-23T18:46:33.187 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T18:46:33.214 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:33.222 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T18:46:33.249 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:33.254 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:33.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:33.386 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T18:46:33.414 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:33.428 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2023-06-23T18:46:33.452 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:33.455 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-23T18:46:33.494 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:33.540 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T18:46:33.556 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:33.574 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T18:46:33.599 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:33.601 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-23T18:46:33.641 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:33.772 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T18:46:33.798 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T18:46:33.800 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-23T18:46:33.813 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-23T18:46:33.838 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:33.847 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:33.943 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T18:46:33.944 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T18:46:33.970 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T18:46:33.971 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:33.997 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T18:46:34.002 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:34.010 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:34.013 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:34.047 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:34.142 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T18:46:34.169 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:34.208 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:34.210 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2023-06-23T18:46:34.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:34.269 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:34.313 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-routes. 2023-06-23T18:46:34.339 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-23T18:46:34.357 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-23T18:46:34.379 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:34.384 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-23T18:46:34.423 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:34.444 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package jq. 2023-06-23T18:46:34.461 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T18:46:34.472 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:34.489 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:34.511 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-23T18:46:34.528 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:34.725 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T18:46:34.751 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package socat. 2023-06-23T18:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-23T18:46:34.791 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:34.806 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T18:46:34.822 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-23T18:46:34.830 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:34.853 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-23T18:46:34.856 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-23T18:46:34.881 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-23T18:46:34.920 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:35.093 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T18:46:35.120 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:35.159 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T18:46:35.159 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:35.186 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-23T18:46:35.225 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:35.228 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-23T18:46:35.248 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T18:46:35.254 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-23T18:46:35.275 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T18:46:35.294 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:35.420 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T18:46:35.448 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:35.487 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:35.497 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T18:46:35.571 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-test. 2023-06-23T18:46:35.599 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:35.629 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:35.731 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T18:46:35.747 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:35.781 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:35.827 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T18:46:35.831 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T18:46:35.854 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-23T18:46:35.858 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-23T18:46:35.893 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:35.897 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T18:46:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:36.179 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T18:46:36.185 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:36.207 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-23T18:46:36.235 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-23T18:46:36.237 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:36.262 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-23T18:46:36.301 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:36.515 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-23T18:46:36.539 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-23T18:46:36.547 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T18:46:36.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:36.581 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:36.582 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-py. 2023-06-23T18:46:36.606 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:36.610 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-23T18:46:36.637 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T18:46:36.648 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-23T18:46:36.665 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-23T18:46:36.704 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:36.952 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pygments. 2023-06-23T18:46:36.980 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-23T18:46:36.993 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-23T18:46:37.018 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:37.020 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-23T18:46:37.045 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T18:46:37.060 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:37.072 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:37.111 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:37.362 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T18:46:37.389 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T18:46:37.390 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T18:46:37.416 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-23T18:46:37.438 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T18:46:37.446 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T18:46:37.447 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-23T18:46:37.465 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:37.474 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T18:46:37.501 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-23T18:46:37.504 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:37.539 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:37.667 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T18:46:37.683 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:37.725 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:37.766 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T18:46:37.794 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-23T18:46:37.826 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-toml. 2023-06-23T18:46:37.841 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:37.853 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-23T18:46:37.892 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-23T18:46:37.933 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T18:46:37.950 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:37.983 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:37.986 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T18:46:38.013 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:38.053 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:38.111 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T18:46:38.138 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-23T18:46:38.169 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:38.203 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T18:46:38.231 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-23T18:46:38.270 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:46:38.305 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T18:46:38.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:38.330 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T18:46:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:38.358 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:38.388 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:38.497 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-py. 2023-06-23T18:46:38.515 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T18:46:38.525 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-23T18:46:38.543 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-23T18:46:38.564 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-23T18:46:38.590 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:38.624 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T18:46:38.651 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-23T18:46:38.684 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T18:46:38.690 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:38.700 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T18:46:38.711 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:38.728 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-23T18:46:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:38.766 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-23T18:46:38.843 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pygments. 2023-06-23T18:46:38.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T18:46:38.870 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-23T18:46:38.896 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-23T18:46:38.901 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:38.926 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:38.984 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T18:46:39.001 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-23T18:46:39.027 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T18:46:39.043 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:39.044 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:39.080 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-23T18:46:39.086 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:39.108 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-23T18:46:39.147 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:39.271 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T18:46:39.298 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-23T18:46:39.337 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:46:39.339 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T18:46:39.347 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T18:46:39.364 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:39.366 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-23T18:46:39.405 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:39.405 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:39.584 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-23T18:46:39.611 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-23T18:46:39.633 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T18:46:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T18:46:39.650 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:39.650 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:39.676 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-23T18:46:39.683 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:39.705 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package radosgw. 2023-06-23T18:46:39.716 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-toml. 2023-06-23T18:46:39.724 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-23T18:46:39.733 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../113-radosgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:39.744 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-23T18:46:39.763 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:39.783 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-23T18:46:39.911 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T18:46:39.938 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T18:46:39.969 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T18:46:40.037 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T18:46:40.065 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:40.086 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T18:46:40.095 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T18:46:40.103 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:40.114 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-23T18:46:40.122 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-23T18:46:40.152 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:46:40.170 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-23T18:46:40.290 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T18:46:40.317 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-23T18:46:40.348 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T18:46:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-23T18:46:40.458 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-23T18:46:40.475 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-23T18:46:40.490 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T18:46:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:46:40.516 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:40.517 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-23T18:46:40.556 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:40.660 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T18:46:40.683 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T18:46:40.687 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-23T18:46:40.708 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:40.749 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:40.749 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T18:46:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-23T18:46:40.817 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T18:46:40.834 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-23T18:46:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-23T18:46:40.876 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:40.978 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-23T18:46:41.006 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-23T18:46:41.036 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:41.044 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:41.087 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2023-06-23T18:46:41.115 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-23T18:46:41.154 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-23T18:46:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T18:46:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-23T18:46:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:46:41.305 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:41.348 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T18:46:41.376 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T18:46:41.414 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T18:46:41.422 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:41.482 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2023-06-23T18:46:41.510 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-23T18:46:41.549 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:41.647 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package radosgw. 2023-06-23T18:46:41.657 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-23T18:46:41.674 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../113-radosgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:41.713 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:41.726 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T18:46:41.754 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-23T18:46:41.792 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:41.935 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T18:46:41.951 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:41.993 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:42.004 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-23T18:46:42.020 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T18:46:42.047 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-23T18:46:42.086 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:42.104 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T18:46:42.132 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-23T18:46:42.170 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T18:46:42.278 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-23T18:46:42.312 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:42.391 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T18:46:42.397 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2023-06-23T18:46:42.407 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:42.425 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-23T18:46:42.441 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:42.464 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-23T18:46:42.487 INFO:teuthology.orchestra.run.smithi192.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-23T18:46:42.490 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-py. 2023-06-23T18:46:42.518 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-23T18:46:42.556 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-23T18:46:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:42.725 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T18:46:42.737 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:42.742 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-23T18:46:42.775 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:46:42.876 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T18:46:42.877 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pygments. 2023-06-23T18:46:42.901 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:42.905 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-23T18:46:42.932 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:42.943 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:42.997 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:43.118 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user cephadm....done 2023-06-23T18:46:43.120 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T18:46:43.122 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:43.149 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-23T18:46:43.185 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package jq. 2023-06-23T18:46:43.186 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:43.212 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-23T18:46:43.251 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-23T18:46:43.272 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:43.363 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-23T18:46:43.389 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T18:46:43.418 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-23T18:46:43.447 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:43.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T18:46:43.487 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package socat. 2023-06-23T18:46:43.488 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-23T18:46:43.503 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-23T18:46:43.531 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:43.532 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:43.545 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:43.737 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-23T18:46:43.750 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-toml. 2023-06-23T18:46:43.767 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:43.778 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-23T18:46:43.817 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-23T18:46:43.890 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T18:46:43.892 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:43.917 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-23T18:46:43.956 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:44.128 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T18:46:44.144 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:44.156 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-23T18:46:44.194 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:46:44.230 INFO:teuthology.orchestra.run.smithi118.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-23T18:46:44.260 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2023-06-23T18:46:44.276 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-radosgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:44.328 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-test. 2023-06-23T18:46:44.353 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:44.355 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:44.394 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:44.404 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:44.530 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-23T18:46:44.548 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T18:46:44.576 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-23T18:46:44.614 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:44.831 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:44.892 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T18:46:44.909 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-23T18:46:44.951 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:44.969 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user cephadm....done 2023-06-23T18:46:45.046 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T18:46:45.074 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:45.123 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:45.167 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:45.383 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-23T18:46:45.433 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:45.685 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:45.711 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-23T18:46:45.786 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:45.886 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:45.957 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package radosgw. 2023-06-23T18:46:45.985 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../113-radosgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:45.987 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:46.023 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:46.035 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:46.050 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-23T18:46:46.238 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:46.320 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:46.419 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-23T18:46:46.481 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:46.580 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:46.614 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T18:46:46.641 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:46.686 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:46.706 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-23T18:46:46.741 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:46.893 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-23T18:46:46.901 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T18:46:46.926 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:46.968 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:46.996 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:47.016 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:47.086 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T18:46:47.113 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:47.125 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:47.152 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:47.240 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:47.251 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-23T18:46:47.351 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T18:46:47.498 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:47.510 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:47.524 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-23T18:46:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2023-06-23T18:46:47.563 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-23T18:46:47.595 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-23T18:46:47.624 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:47.660 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:47.762 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:46:47.808 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T18:46:47.824 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:47.862 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-23T18:46:47.874 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:47.888 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:47.890 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-23T18:46:47.920 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:48.110 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T18:46:48.126 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4479-g8627af3e-1jammy_all.deb ... 2023-06-23T18:46:48.130 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:48.163 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:48.168 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:48.234 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-23T18:46:48.247 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:48.289 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:48.348 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-23T18:46:48.396 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T18:46:48.407 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:48.412 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:48.446 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:48.540 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:48.599 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:48.649 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:48.693 INFO:teuthology.orchestra.run.smithi038.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-23T18:46:48.810 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:48.833 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:48.859 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:48.916 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T18:46:48.917 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:48.943 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-23T18:46:48.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-23T18:46:48.991 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:49.177 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:49.193 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:49.286 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:49.303 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-23T18:46:49.363 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-23T18:46:49.390 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-23T18:46:49.437 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:49.495 INFO:teuthology.orchestra.run.smithi038.stdout:Adding system user cephadm....done 2023-06-23T18:46:49.579 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:49.638 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:49.649 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:49.830 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:46:49.837 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:49.865 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-23T18:46:49.879 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-23T18:46:49.889 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-23T18:46:49.923 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:49.934 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:49.956 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:50.089 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:50.124 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-23T18:46:50.160 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T18:46:50.169 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:50.175 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T18:46:50.189 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:50.218 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T18:46:50.290 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:46:50.295 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:50.332 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:50.392 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:50.442 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-23T18:46:50.521 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T18:46:50.549 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-23T18:46:50.587 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:50.608 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:50.635 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:50.663 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:50.726 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:50.903 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:50.914 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:50.949 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T18:46:50.976 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-23T18:46:50.993 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:51.003 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:51.015 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:51.049 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-23T18:46:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:51.244 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:51.321 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:51.360 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-py. 2023-06-23T18:46:51.384 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:51.387 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-23T18:46:51.426 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-23T18:46:51.488 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:51.606 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-23T18:46:51.621 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:51.744 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-23T18:46:51.755 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pygments. 2023-06-23T18:46:51.782 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-23T18:46:51.821 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:51.865 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:51.906 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-23T18:46:51.998 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:52.020 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-23T18:46:52.125 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:46:52.190 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:52.249 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:52.251 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:52.272 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-23T18:46:52.300 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T18:46:52.328 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-23T18:46:52.350 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:52.367 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:52.468 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:46:52.500 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:52.540 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:46:52.611 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:52.661 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-toml. 2023-06-23T18:46:52.688 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-23T18:46:52.720 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-23T18:46:52.727 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-23T18:46:52.742 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:52.769 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:52.791 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:46:52.868 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:52.987 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:52.988 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T18:46:53.016 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-23T18:46:53.050 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:46:53.154 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:53.161 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-idna (3.3-1) ... 2023-06-23T18:46:53.213 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:46:53.272 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:53.302 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:53.405 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:53.488 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:53.565 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:53.575 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T18:46:53.586 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:46:53.603 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-23T18:46:53.643 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:53.704 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-23T18:46:53.815 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:53.911 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T18:46:53.939 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-23T18:46:53.955 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:46:53.977 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:54.091 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-23T18:46:54.189 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:46:54.209 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:54.315 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-23T18:46:54.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:54.577 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:54.669 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:54.683 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:54.695 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:46:54.736 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:54.798 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package radosgw. 2023-06-23T18:46:54.801 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-23T18:46:54.803 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-23T18:46:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../113-radosgw_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:54.865 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:55.004 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:55.044 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:46:55.062 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:46:55.079 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:55.189 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:55.205 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:55.290 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:55.328 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:46:55.397 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:55.506 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-idna (3.3-1) ... 2023-06-23T18:46:55.566 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:55.632 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:55.634 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T18:46:55.650 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4479-g8627af3e-1jammy_amd64.deb ... 2023-06-23T18:46:55.671 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:46:55.692 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:55.817 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:55.832 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:55.979 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-23T18:46:56.000 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:56.077 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:56.203 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:46:56.230 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-23T18:46:56.285 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-23T18:46:56.329 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:56.356 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-23T18:46:56.373 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:46:56.578 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:56.613 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-23T18:46:56.639 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:56.642 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:46:56.767 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:46:56.873 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-23T18:46:56.893 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:46:56.905 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:56.929 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:56.950 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-23T18:46:57.039 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-23T18:46:57.107 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-23T18:46:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:57.194 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-23T18:46:57.291 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:46:57.306 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:57.359 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:57.388 INFO:teuthology.orchestra.run.smithi164.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-23T18:46:57.408 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:57.458 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:57.534 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:57.579 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-23T18:46:57.599 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1) ... 2023-06-23T18:46:57.609 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-23T18:46:57.813 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:46:57.844 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:46:57.877 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:46:57.909 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:46:57.952 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user cephadm....done 2023-06-23T18:46:58.012 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-23T18:46:58.121 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-23T18:46:58.131 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-23T18:46:58.190 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:46:58.305 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:46:58.355 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:58.406 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:46:58.416 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-23T18:46:58.475 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-23T18:46:58.481 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:46:58.582 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:46:58.650 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-23T18:46:58.673 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:46:58.751 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-23T18:46:58.784 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:46:58.884 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:46:58.975 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:46:58.986 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T18:46:59.090 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:46:59.135 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-23T18:46:59.153 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:46:59.224 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-23T18:46:59.237 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-23T18:46:59.251 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:46:59.363 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-23T18:46:59.412 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:46:59.436 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-23T18:46:59.500 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:46:59.513 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:46:59.618 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:46:59.638 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-23T18:46:59.673 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-23T18:46:59.704 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:46:59.719 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:46:59.848 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-idna (3.3-1) ... 2023-06-23T18:46:59.887 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:46:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-23T18:47:00.004 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:47:00.005 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:47:00.042 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-23T18:47:00.191 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:47:00.206 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:47:00.263 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-23T18:47:00.285 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-23T18:47:00.307 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-23T18:47:00.373 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:47:00.506 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:00.519 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-23T18:47:00.585 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:47:00.616 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-23T18:47:00.632 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:47:00.712 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:47:00.758 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:47:00.787 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-23T18:47:00.884 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:00.996 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:47:01.010 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-23T18:47:01.038 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-23T18:47:01.051 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:47:01.297 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-23T18:47:01.298 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:47:01.302 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-23T18:47:01.336 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:47:01.396 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:01.531 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-23T18:47:01.540 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:47:01.548 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-argparse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:01.562 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-23T18:47:01.638 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:47:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:47:01.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:47:01.824 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-23T18:47:01.922 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-23T18:47:01.942 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:47:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-23T18:47:01.950 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-23T18:47:02.023 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-23T18:47:02.056 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-23T18:47:02.068 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:47:02.185 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-23T18:47:02.192 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:47:02.265 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-23T18:47:02.307 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:47:02.327 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:47:02.386 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:47:02.410 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-23T18:47:02.435 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-23T18:47:02.525 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:47:02.536 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-23T18:47:02.645 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-23T18:47:02.703 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:47:02.719 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:47:02.793 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:47:02.845 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:47:02.888 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:02.896 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-23T18:47:02.937 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-23T18:47:02.997 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:47:03.022 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-23T18:47:03.115 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:47:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:47:03.178 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T18:47:03.247 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:03.348 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-23T18:47:03.425 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:47:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:47:03.463 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:47:03.481 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-23T18:47:03.649 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:47:03.668 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-23T18:47:03.715 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:47:03.749 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-23T18:47:03.790 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:47:03.908 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:03.927 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-23T18:47:03.950 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:47:04.034 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:04.050 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-23T18:47:04.123 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-23T18:47:04.178 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:47:04.226 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-23T18:47:04.254 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:04.360 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-23T18:47:04.377 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:47:04.380 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:04.438 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-23T18:47:04.481 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:04.486 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:47:04.582 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-23T18:47:04.612 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-23T18:47:04.706 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:47:04.727 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-23T18:47:04.823 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-23T18:47:04.859 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:04.862 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:47:04.888 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:47:04.970 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-23T18:47:04.985 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:05.096 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-23T18:47:05.108 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:47:05.111 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:05.122 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:47:05.139 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-23T18:47:05.217 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:47:05.222 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-23T18:47:05.328 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:05.328 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:05.374 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:05.498 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T18:47:05.499 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-23T18:47:05.502 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:47:05.556 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-23T18:47:05.766 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:47:05.803 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:47:05.825 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:47:05.838 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:05.941 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-23T18:47:05.947 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.048 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.063 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:47:06.093 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:47:06.127 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:47:06.157 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:47:06.184 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-23T18:47:06.203 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.312 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.386 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-23T18:47:06.462 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-23T18:47:06.512 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-23T18:47:06.532 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.535 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-23T18:47:06.658 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.708 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:47:06.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-23T18:47:06.783 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-23T18:47:06.834 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:47:06.909 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-23T18:47:07.048 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:47:07.104 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-23T18:47:07.203 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.227 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:47:07.312 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.324 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:47:07.379 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.430 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.438 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-23T18:47:07.478 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-23T18:47:07.488 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.590 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.643 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:07.643 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:07.690 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-23T18:47:07.691 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T18:47:07.737 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:07.816 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.817 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.863 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-23T18:47:07.943 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:07.985 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:47:08.084 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-idna (3.3-1) ... 2023-06-23T18:47:08.173 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:47:08.181 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.304 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:47:08.308 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.393 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-23T18:47:08.413 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.482 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:47:08.486 INFO:teuthology.orchestra.run.smithi192.stdout:Adding group ceph....done 2023-06-23T18:47:08.515 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.726 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.734 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.759 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-23T18:47:08.796 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user ceph....done 2023-06-23T18:47:08.853 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.869 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:47:08.885 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-23T18:47:08.973 INFO:teuthology.orchestra.run.smithi192.stdout:Setting system user ceph properties....done 2023-06-23T18:47:08.979 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:08.990 INFO:teuthology.orchestra.run.smithi192.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T18:47:09.105 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-23T18:47:09.124 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T18:47:09.144 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-23T18:47:09.365 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:09.420 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:47:09.463 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T18:47:09.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:09.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:09.713 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:47:09.725 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-23T18:47:09.858 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:09.858 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:09.976 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-23T18:47:10.007 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.019 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.093 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-23T18:47:10.106 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T18:47:10.132 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.219 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-23T18:47:10.235 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:10.235 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:10.258 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.399 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:47:10.410 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.519 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.521 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-23T18:47:10.536 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.645 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.662 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.751 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:47:10.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:47:10.781 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-23T18:47:10.788 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.878 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:10.897 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.004 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.031 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:11.135 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:11.136 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:11.157 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-23T18:47:11.196 INFO:teuthology.orchestra.run.smithi118.stdout:Adding group ceph....done 2023-06-23T18:47:11.216 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.283 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-23T18:47:11.342 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.468 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.514 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user ceph....done 2023-06-23T18:47:11.584 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-23T18:47:11.594 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-23T18:47:11.666 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties....done 2023-06-23T18:47:11.684 INFO:teuthology.orchestra.run.smithi118.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T18:47:11.815 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T18:47:11.827 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-23T18:47:11.871 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.919 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:11.997 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.010 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-23T18:47:12.111 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.123 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.128 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T18:47:12.237 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.280 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T18:47:12.313 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T18:47:12.343 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:12.343 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:12.363 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.489 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.564 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-23T18:47:12.615 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.662 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.804 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.823 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-23T18:47:12.866 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:12.907 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:12.908 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:12.943 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-23T18:47:13.009 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:13.038 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:13.038 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:13.135 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:13.142 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2023-06-23T18:47:13.219 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-23T18:47:13.253 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:47:13.337 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-23T18:47:13.447 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:13.535 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2023-06-23T18:47:13.556 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:13.590 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:13.613 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-23T18:47:13.694 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2023-06-23T18:47:13.705 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T18:47:13.805 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:13.805 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:13.812 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:13.812 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:13.839 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T18:47:13.897 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-23T18:47:14.148 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-23T18:47:14.205 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T18:47:14.333 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.501 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.524 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-23T18:47:14.575 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.605 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:14.606 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:14.627 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.742 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.753 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.768 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-23T18:47:14.879 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:14.885 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-23T18:47:14.922 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T18:47:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:14.980 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.081 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.176 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.270 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-23T18:47:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.485 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.510 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.529 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-23T18:47:15.603 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:Adding group ceph....done 2023-06-23T18:47:15.627 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:15.627 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:15.737 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:15.738 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:15.780 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-23T18:47:15.859 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:15.859 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:15.906 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-23T18:47:15.984 INFO:teuthology.orchestra.run.smithi038.stdout:Adding system user ceph....done 2023-06-23T18:47:16.111 INFO:teuthology.orchestra.run.smithi038.stdout:Setting system user ceph properties....done 2023-06-23T18:47:16.127 INFO:teuthology.orchestra.run.smithi038.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T18:47:16.155 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.249 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-23T18:47:16.266 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T18:47:16.271 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.297 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.423 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.542 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-06-23T18:47:16.550 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:16.550 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:16.574 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.579 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T18:47:16.638 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:16.693 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:47:16.809 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-23T18:47:16.927 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-23T18:47:16.938 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T18:47:17.091 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:17.119 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:17.178 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-23T18:47:17.309 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:17.309 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:17.446 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-23T18:47:17.474 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:17.546 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:17.546 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:17.705 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-23T18:47:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:17.711 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:17.834 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:17.905 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:17.935 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.090 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T18:47:18.149 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.177 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:18.177 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:18.208 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.325 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.352 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:47:18.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-23T18:47:18.399 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-23T18:47:18.415 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:18.415 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:18.454 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T18:47:18.476 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.630 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T18:47:18.631 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T18:47:18.686 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:18.687 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:18.769 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-23T18:47:18.788 INFO:teuthology.orchestra.run.smithi192.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-23T18:47:18.788 INFO:teuthology.orchestra.run.smithi192.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-23T18:47:18.788 INFO:teuthology.orchestra.run.smithi192.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:18.788 INFO:teuthology.orchestra.run.smithi192.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:18.788 INFO:teuthology.orchestra.run.smithi192.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-23T18:47:18.789 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:47:18.789 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:47:18.789 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:47:18.789 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:47:18.789 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:47:18.790 INFO:teuthology.orchestra.run.smithi192.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:47:18.790 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:47:18.790 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:18.791 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T18:47:18.792 INFO:teuthology.orchestra.run.smithi192.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-23T18:47:18.792 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-23T18:47:18.792 INFO:teuthology.orchestra.run.smithi192.stdout: libengine-pkcs11-openssl 2023-06-23T18:47:18.824 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T18:47:18.825 INFO:teuthology.orchestra.run.smithi192.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-23T18:47:18.825 INFO:teuthology.orchestra.run.smithi192.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-23T18:47:18.826 INFO:teuthology.orchestra.run.smithi192.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-23T18:47:18.826 INFO:teuthology.orchestra.run.smithi192.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-23T18:47:18.826 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-23T18:47:18.826 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-23T18:47:18.826 INFO:teuthology.orchestra.run.smithi192.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:18.827 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-06-23T18:47:18.827 INFO:teuthology.orchestra.run.smithi192.stdout: libssl3 2023-06-23T18:47:18.878 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librados2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.904 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:18.935 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.004 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librgw2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.006 INFO:teuthology.orchestra.run.smithi192.stdout:1 upgraded, 39 newly installed, 0 to remove and 199 not upgraded. 2023-06-23T18:47:19.006 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 54.6 MB of archives. 2023-06-23T18:47:19.006 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-23T18:47:19.006 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-23T18:47:19.211 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.215 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.227 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T18:47:19.233 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:19.233 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:19.341 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs2 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.362 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.467 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libradosstriper1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.483 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-23T18:47:19.488 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.602 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-23T18:47:19.639 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.714 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.739 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-23T18:47:19.766 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:47:19.770 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.774 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-23T18:47:19.776 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-23T18:47:19.781 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-23T18:47:19.784 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-23T18:47:19.785 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-23T18:47:19.788 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-23T18:47:19.790 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-23T18:47:19.791 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-23T18:47:19.878 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librbd1 (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.896 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:19.950 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:19.950 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:19.955 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-23T18:47:20.004 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-modules-core (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.030 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.130 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.236 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:20.236 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:20.266 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-23T18:47:20.341 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:20.342 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T18:47:20.457 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:20.466 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.708 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:20.708 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:20.815 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.831 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs-dev (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.910 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:47:20.912 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-23T18:47:20.957 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.958 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rados (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:20.971 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-06-23T18:47:21.067 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-top (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:21.075 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:21.148 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-06-23T18:47:21.149 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-06-23T18:47:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-23T18:47:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:21.306 INFO:teuthology.orchestra.run.smithi118.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-23T18:47:21.306 INFO:teuthology.orchestra.run.smithi118.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-23T18:47:21.306 INFO:teuthology.orchestra.run.smithi118.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:21.306 INFO:teuthology.orchestra.run.smithi118.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:21.307 INFO:teuthology.orchestra.run.smithi118.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-23T18:47:21.307 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:47:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:47:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:47:21.307 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:47:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:47:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:47:21.309 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:47:21.309 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-06-23T18:47:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-23T18:47:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-23T18:47:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-23T18:47:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-23T18:47:21.310 INFO:teuthology.orchestra.run.smithi118.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:21.311 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-06-23T18:47:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-23T18:47:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-23T18:47:21.311 INFO:teuthology.orchestra.run.smithi118.stdout: libengine-pkcs11-openssl 2023-06-23T18:47:21.312 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:47:21.346 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-06-23T18:47:21.347 INFO:teuthology.orchestra.run.smithi118.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-23T18:47:21.347 INFO:teuthology.orchestra.run.smithi118.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-23T18:47:21.347 INFO:teuthology.orchestra.run.smithi118.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-23T18:47:21.348 INFO:teuthology.orchestra.run.smithi118.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-23T18:47:21.348 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-23T18:47:21.348 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-23T18:47:21.349 INFO:teuthology.orchestra.run.smithi118.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:21.349 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2023-06-23T18:47:21.349 INFO:teuthology.orchestra.run.smithi118.stdout: libssl3 2023-06-23T18:47:21.373 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:21.401 INFO:teuthology.orchestra.run.smithi118.stdout:1 upgraded, 39 newly installed, 0 to remove and 199 not upgraded. 2023-06-23T18:47:21.401 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 54.6 MB of archives. 2023-06-23T18:47:21.401 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-23T18:47:21.402 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-23T18:47:21.416 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-23T18:47:21.420 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-23T18:47:21.476 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-23T18:47:21.482 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-23T18:47:21.483 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-23T18:47:21.494 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-23T18:47:21.497 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-23T18:47:21.504 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-23T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-23T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-23T18:47:21.564 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-23T18:47:21.578 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-23T18:47:21.579 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-23T18:47:21.581 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-23T18:47:21.583 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-23T18:47:21.584 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-23T18:47:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-23T18:47:21.586 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-23T18:47:21.622 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-23T18:47:21.623 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-23T18:47:21.672 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-23T18:47:21.729 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-23T18:47:21.761 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:21.761 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:21.812 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-23T18:47:22.040 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-23T18:47:22.042 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-23T18:47:22.042 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-23T18:47:22.044 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-23T18:47:22.045 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-23T18:47:22.048 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-23T18:47:22.050 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-23T18:47:22.056 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-23T18:47:22.091 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-23T18:47:22.275 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-23T18:47:22.287 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-23T18:47:22.298 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.339 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-23T18:47:22.364 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:22.364 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-23T18:47:22.405 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-23T18:47:22.410 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-23T18:47:22.411 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-23T18:47:22.412 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-23T18:47:22.412 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-23T18:47:22.417 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-23T18:47:22.422 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rbd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.424 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.427 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-23T18:47:22.428 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-23T18:47:22.428 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-23T18:47:22.429 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-23T18:47:22.431 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-23T18:47:22.432 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-23T18:47:22.465 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-23T18:47:22.469 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-23T18:47:22.548 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up rbd-fuse (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.575 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.674 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.716 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-23T18:47:22.734 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-23T18:47:22.735 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-23T18:47:22.735 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-23T18:47:22.752 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-23T18:47:22.753 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-23T18:47:22.794 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:22.794 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:22.800 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cephfs (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:22.823 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:47:22.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-23T18:47:22.852 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-23T18:47:22.853 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-23T18:47:22.878 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-23T18:47:22.926 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-shell (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.018 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-23T18:47:23.027 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-common (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.043 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-23T18:47:23.044 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-23T18:47:23.181 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:47:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:47:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:47:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:47:23.183 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:47:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:47:23.184 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:47:23.184 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-23T18:47:23.185 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-23T18:47:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: libengine-pkcs11-openssl 2023-06-23T18:47:23.186 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-23T18:47:23.217 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-23T18:47:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-23T18:47:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:23.219 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-06-23T18:47:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: libssl3 2023-06-23T18:47:23.250 INFO:teuthology.orchestra.run.smithi118.stdout:Preconfiguring packages ... 2023-06-23T18:47:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-23T18:47:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-23T18:47:23.268 INFO:teuthology.orchestra.run.smithi081.stdout:1 upgraded, 39 newly installed, 0 to remove and 199 not upgraded. 2023-06-23T18:47:23.268 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 54.6 MB of archives. 2023-06-23T18:47:23.269 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-23T18:47:23.269 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-23T18:47:23.343 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.348 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-23T18:47:23.356 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-23T18:47:23.367 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-23T18:47:23.421 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 54.6 MB in 1s (36.4 MB/s) 2023-06-23T18:47:23.426 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-23T18:47:23.441 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-23T18:47:23.442 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-23T18:47:23.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-23T18:47:23.446 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-23T18:47:23.447 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-23T18:47:23.449 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-23T18:47:23.450 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-23T18:47:23.469 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.485 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-23T18:47:23.486 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-23T18:47:23.536 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-23T18:47:23.559 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package flex. 2023-06-23T18:47:23.570 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.586 INFO:teuthology.orchestra.run.smithi164.stdout:Adding group ceph....done 2023-06-23T18:47:23.656 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172970 files and directories currently installed.) 2023-06-23T18:47:23.662 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:23.707 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-23T18:47:23.721 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:23.817 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-23T18:47:23.819 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-23T18:47:23.831 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:47:23.914 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-23T18:47:23.916 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-23T18:47:23.917 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-23T18:47:23.919 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-23T18:47:23.920 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-23T18:47:23.924 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-23T18:47:23.925 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-23T18:47:23.933 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-23T18:47:23.967 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-23T18:47:23.980 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user ceph....done 2023-06-23T18:47:24.127 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-23T18:47:24.127 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-23T18:47:24.147 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-23T18:47:24.157 INFO:teuthology.orchestra.run.smithi164.stdout:Setting system user ceph properties....done 2023-06-23T18:47:24.168 INFO:teuthology.orchestra.run.smithi164.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T18:47:24.181 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-23T18:47:24.185 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-23T18:47:24.185 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-23T18:47:24.186 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-23T18:47:24.186 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-23T18:47:24.199 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-23T18:47:24.201 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-23T18:47:24.215 INFO:teuthology.orchestra.run.smithi192.stdout:Preconfiguring packages ... 2023-06-23T18:47:24.290 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:24.300 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T18:47:24.360 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 54.6 MB in 5s (10.9 MB/s) 2023-06-23T18:47:24.441 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-23T18:47:24.459 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-23T18:47:24.459 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-23T18:47:24.460 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-23T18:47:24.462 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-23T18:47:24.469 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package flex. 2023-06-23T18:47:24.477 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-23T18:47:24.479 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-23T18:47:24.532 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172970 files and directories currently installed.) 2023-06-23T18:47:24.538 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:24.577 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-23T18:47:24.579 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-23T18:47:24.580 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-23T18:47:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T18:47:24.871 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:24.966 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:24.983 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2023-06-23T18:47:25.112 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephfs-mirror (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:25.159 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 54.6 MB in 1s (40.3 MB/s) 2023-06-23T18:47:25.169 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:25.296 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package flex. 2023-06-23T18:47:25.321 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:25.322 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-06-23T18:47:25.341 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-23T18:47:25.398 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172970 files and directories currently installed.) 2023-06-23T18:47:25.404 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:47:25.425 DEBUG:teuthology.orchestra.run.smithi038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-23T18:47:25.430 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package bison. 2023-06-23T18:47:25.444 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-23T18:47:25.480 INFO:teuthology.orchestra.run.smithi038.stdout:Reading package lists... 2023-06-23T18:47:25.535 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173043 files and directories currently installed.) 2023-06-23T18:47:25.541 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:25.599 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:25.664 INFO:teuthology.orchestra.run.smithi038.stdout:Building dependency tree... 2023-06-23T18:47:25.665 INFO:teuthology.orchestra.run.smithi038.stdout:Reading state information... 2023-06-23T18:47:25.760 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:25.821 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-test (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:25.828 INFO:teuthology.orchestra.run.smithi038.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-23T18:47:25.829 INFO:teuthology.orchestra.run.smithi038.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-23T18:47:25.829 INFO:teuthology.orchestra.run.smithi038.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:25.830 INFO:teuthology.orchestra.run.smithi038.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:25.830 INFO:teuthology.orchestra.run.smithi038.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-23T18:47:25.830 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:47:25.830 INFO:teuthology.orchestra.run.smithi038.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:47:25.830 INFO:teuthology.orchestra.run.smithi038.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:47:25.831 INFO:teuthology.orchestra.run.smithi038.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:47:25.831 INFO:teuthology.orchestra.run.smithi038.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:47:25.831 INFO:teuthology.orchestra.run.smithi038.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:47:25.832 INFO:teuthology.orchestra.run.smithi038.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:47:25.833 INFO:teuthology.orchestra.run.smithi038.stdout:The following additional packages will be installed: 2023-06-23T18:47:25.833 INFO:teuthology.orchestra.run.smithi038.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-23T18:47:25.833 INFO:teuthology.orchestra.run.smithi038.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout:Suggested packages: 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-23T18:47:25.834 INFO:teuthology.orchestra.run.smithi038.stdout: libengine-pkcs11-openssl 2023-06-23T18:47:25.868 INFO:teuthology.orchestra.run.smithi038.stdout:The following NEW packages will be installed: 2023-06-23T18:47:25.869 INFO:teuthology.orchestra.run.smithi038.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-23T18:47:25.870 INFO:teuthology.orchestra.run.smithi038.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-23T18:47:25.870 INFO:teuthology.orchestra.run.smithi038.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-23T18:47:25.870 INFO:teuthology.orchestra.run.smithi038.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-23T18:47:25.870 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-23T18:47:25.870 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-23T18:47:25.871 INFO:teuthology.orchestra.run.smithi038.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:25.871 INFO:teuthology.orchestra.run.smithi038.stdout:The following packages will be upgraded: 2023-06-23T18:47:25.872 INFO:teuthology.orchestra.run.smithi038.stdout: libssl3 2023-06-23T18:47:25.947 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up radosgw (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:25.991 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T18:47:26.007 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-23T18:47:26.041 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:26.052 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:26.052 INFO:teuthology.orchestra.run.smithi038.stdout:1 upgraded, 39 newly installed, 0 to remove and 199 not upgraded. 2023-06-23T18:47:26.052 INFO:teuthology.orchestra.run.smithi038.stdout:Need to get 54.6 MB of archives. 2023-06-23T18:47:26.052 INFO:teuthology.orchestra.run.smithi038.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-23T18:47:26.053 INFO:teuthology.orchestra.run.smithi038.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-23T18:47:26.220 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:26.221 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T18:47:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-23T18:47:26.293 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package bison. 2023-06-23T18:47:26.352 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package dump. 2023-06-23T18:47:26.380 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-23T18:47:26.393 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173043 files and directories currently installed.) 2023-06-23T18:47:26.399 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:26.419 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking dump (0.4b47-3) ... 2023-06-23T18:47:26.453 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:26.531 INFO:teuthology.orchestra.run.smithi038.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-23T18:47:26.703 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:26.705 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package indent. 2023-06-23T18:47:26.733 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-23T18:47:26.772 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-23T18:47:26.814 INFO:teuthology.orchestra.run.smithi038.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-23T18:47:26.831 INFO:teuthology.orchestra.run.smithi038.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-23T18:47:26.832 INFO:teuthology.orchestra.run.smithi038.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-23T18:47:26.836 INFO:teuthology.orchestra.run.smithi038.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-23T18:47:26.838 INFO:teuthology.orchestra.run.smithi038.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-23T18:47:26.840 INFO:teuthology.orchestra.run.smithi038.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-23T18:47:26.842 INFO:teuthology.orchestra.run.smithi038.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-23T18:47:26.844 INFO:teuthology.orchestra.run.smithi038.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-23T18:47:26.863 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T18:47:26.890 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-23T18:47:26.907 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-base (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:26.930 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:27.009 INFO:teuthology.orchestra.run.smithi038.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-23T18:47:27.010 INFO:teuthology.orchestra.run.smithi038.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-23T18:47:27.041 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T18:47:27.069 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-23T18:47:27.124 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:27.219 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package bison. 2023-06-23T18:47:27.228 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T18:47:27.254 INFO:teuthology.orchestra.run.smithi038.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-23T18:47:27.291 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package dump. 2023-06-23T18:47:27.319 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-23T18:47:27.321 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173043 files and directories currently installed.) 2023-06-23T18:47:27.327 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:27.358 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking dump (0.4b47-3) ... 2023-06-23T18:47:27.380 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:27.420 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T18:47:27.448 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-23T18:47:27.478 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:27.611 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package indent. 2023-06-23T18:47:27.624 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-23T18:47:27.653 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-23T18:47:27.722 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T18:47:27.738 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-23T18:47:27.756 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T18:47:27.759 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mds (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:27.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-23T18:47:27.780 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:27.805 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:27.905 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T18:47:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-23T18:47:27.969 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:27.970 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T18:47:27.972 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:28.100 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2023-06-23T18:47:28.116 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-23T18:47:28.117 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-23T18:47:28.145 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b47-3) ... 2023-06-23T18:47:28.183 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:28.301 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T18:47:28.328 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-23T18:47:28.367 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:28.390 INFO:teuthology.orchestra.run.smithi038.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-23T18:47:28.395 INFO:teuthology.orchestra.run.smithi038.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-23T18:47:28.404 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2023-06-23T18:47:28.420 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-23T18:47:28.435 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-23T18:47:28.448 INFO:teuthology.orchestra.run.smithi038.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-23T18:47:28.452 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-23T18:47:28.454 INFO:teuthology.orchestra.run.smithi038.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-23T18:47:28.455 INFO:teuthology.orchestra.run.smithi038.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-23T18:47:28.466 INFO:teuthology.orchestra.run.smithi038.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-23T18:47:28.469 INFO:teuthology.orchestra.run.smithi038.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-23T18:47:28.487 INFO:teuthology.orchestra.run.smithi038.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-23T18:47:28.496 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:28.603 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T18:47:28.619 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-23T18:47:28.651 INFO:teuthology.orchestra.run.smithi038.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-23T18:47:28.653 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:28.665 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:28.666 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T18:47:28.681 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T18:47:28.697 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-23T18:47:28.731 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:28.796 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjson-perl. 2023-06-23T18:47:28.812 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-23T18:47:28.846 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-23T18:47:29.007 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-23T18:47:29.034 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:29.060 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T18:47:29.073 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-23T18:47:29.127 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:29.132 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-23T18:47:29.160 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-23T18:47:29.199 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:29.308 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-osd (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:29.326 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-23T18:47:29.349 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:29.373 INFO:teuthology.orchestra.run.smithi038.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-23T18:47:29.374 INFO:teuthology.orchestra.run.smithi038.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-23T18:47:29.392 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:29.396 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T18:47:29.402 INFO:teuthology.orchestra.run.smithi038.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-23T18:47:29.412 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-23T18:47:29.454 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:29.478 INFO:teuthology.orchestra.run.smithi038.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-23T18:47:29.486 INFO:teuthology.orchestra.run.smithi038.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-23T18:47:29.487 INFO:teuthology.orchestra.run.smithi038.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-23T18:47:29.489 INFO:teuthology.orchestra.run.smithi038.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-23T18:47:29.490 INFO:teuthology.orchestra.run.smithi038.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-23T18:47:29.516 INFO:teuthology.orchestra.run.smithi038.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-23T18:47:29.519 INFO:teuthology.orchestra.run.smithi038.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-23T18:47:29.611 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:29.611 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T18:47:29.630 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjson-perl. 2023-06-23T18:47:29.646 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-23T18:47:29.680 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-23T18:47:29.724 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-23T18:47:29.752 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:29.782 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:30.000 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-23T18:47:30.016 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-23T18:47:30.043 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-23T18:47:30.059 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:30.071 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:30.110 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:30.134 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:30.232 INFO:teuthology.orchestra.run.smithi038.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-23T18:47:30.244 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:30.314 INFO:teuthology.orchestra.run.smithi038.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-23T18:47:30.315 INFO:teuthology.orchestra.run.smithi038.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-23T18:47:30.315 INFO:teuthology.orchestra.run.smithi038.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-23T18:47:30.379 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjson-perl. 2023-06-23T18:47:30.395 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-23T18:47:30.404 INFO:teuthology.orchestra.run.smithi038.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-23T18:47:30.410 INFO:teuthology.orchestra.run.smithi038.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-23T18:47:30.420 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mon (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:30.437 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-23T18:47:30.629 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:30.629 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T18:47:30.860 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T18:47:30.867 INFO:teuthology.orchestra.run.smithi038.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-23T18:47:30.870 INFO:teuthology.orchestra.run.smithi038.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-23T18:47:30.874 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-23T18:47:30.887 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:30.902 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-23T18:47:30.935 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:30.941 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:31.113 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-cephadm (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:31.204 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T18:47:31.232 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:31.255 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:31.270 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:31.282 INFO:teuthology.orchestra.run.smithi038.stdout:Preconfiguring packages ... 2023-06-23T18:47:31.382 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-dashboard (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:31.440 INFO:teuthology.orchestra.run.smithi038.stdout:Fetched 54.6 MB in 5s (10.9 MB/s) 2023-06-23T18:47:31.532 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-volume (18.0.0-4479-g8627af3e-1jammy) ... 2023-06-23T18:47:31.552 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package flex. 2023-06-23T18:47:31.598 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T18:47:31.625 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:31.643 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:47:31.653 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172970 files and directories currently installed.) 2023-06-23T18:47:31.659 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:31.664 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:31.700 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-23T18:47:31.894 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T18:47:31.922 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:31.942 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T18:47:31.958 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-23T18:47:31.961 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:31.992 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:32.213 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T18:47:32.225 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:32.229 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:32.263 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:32.336 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T18:47:32.365 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:32.398 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-23T18:47:32.403 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:32.524 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T18:47:32.552 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:32.591 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:32.661 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T18:47:32.682 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:32.705 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-23T18:47:32.718 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:32.719 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:32.722 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:32.755 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:32.826 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:32.901 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T18:47:32.918 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-23T18:47:32.951 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:32.989 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T18:47:33.005 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:33.047 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:33.092 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T18:47:33.120 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:33.158 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:33.161 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:47:33.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-23T18:47:33.217 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2023-06-23T18:47:33.246 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T18:47:33.274 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:33.312 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:33.325 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T18:47:33.325 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package bison. 2023-06-23T18:47:33.349 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:33.383 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:33.391 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2023-06-23T18:47:33.392 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2023-06-23T18:47:33.428 INFO:teuthology.orchestra.run.smithi038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173043 files and directories currently installed.) 2023-06-23T18:47:33.434 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:33.461 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T18:47:33.478 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:33.489 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:33.527 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:33.550 INFO:teuthology.orchestra.run.smithi164.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-23T18:47:33.550 INFO:teuthology.orchestra.run.smithi164.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-23T18:47:33.550 INFO:teuthology.orchestra.run.smithi164.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-23T18:47:33.551 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-23T18:47:33.552 INFO:teuthology.orchestra.run.smithi164.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-23T18:47:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:33.554 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2023-06-23T18:47:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-23T18:47:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-23T18:47:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: libengine-pkcs11-openssl 2023-06-23T18:47:33.587 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2023-06-23T18:47:33.588 INFO:teuthology.orchestra.run.smithi164.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-23T18:47:33.588 INFO:teuthology.orchestra.run.smithi164.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-23T18:47:33.588 INFO:teuthology.orchestra.run.smithi164.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-23T18:47:33.588 INFO:teuthology.orchestra.run.smithi164.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-23T18:47:33.588 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-23T18:47:33.589 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-23T18:47:33.589 INFO:teuthology.orchestra.run.smithi164.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T18:47:33.589 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2023-06-23T18:47:33.589 INFO:teuthology.orchestra.run.smithi164.stdout: libssl3 2023-06-23T18:47:33.598 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-23T18:47:33.614 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:33.648 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:33.744 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T18:47:33.768 INFO:teuthology.orchestra.run.smithi164.stdout:1 upgraded, 39 newly installed, 0 to remove and 199 not upgraded. 2023-06-23T18:47:33.768 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 54.6 MB of archives. 2023-06-23T18:47:33.768 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-23T18:47:33.768 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-23T18:47:33.771 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T18:47:33.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-23T18:47:33.787 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:33.811 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:33.829 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T18:47:33.915 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-23T18:47:33.953 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:33.993 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T18:47:34.021 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:34.059 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:34.164 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T18:47:34.192 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:34.230 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:34.246 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-23T18:47:34.298 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package dump. 2023-06-23T18:47:34.324 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T18:47:34.326 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-23T18:47:34.337 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T18:47:34.352 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-23T18:47:34.353 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:34.364 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking dump (0.4b47-3) ... 2023-06-23T18:47:34.387 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:34.391 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:34.503 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-23T18:47:34.533 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-23T18:47:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-23T18:47:34.539 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-23T18:47:34.544 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-23T18:47:34.548 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-23T18:47:34.549 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-23T18:47:34.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-23T18:47:34.554 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-23T18:47:34.561 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:34.592 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:34.618 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package indent. 2023-06-23T18:47:34.622 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T18:47:34.635 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-23T18:47:34.650 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:34.676 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-23T18:47:34.689 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:34.719 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-23T18:47:34.720 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-23T18:47:34.744 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package modemmanager. 2023-06-23T18:47:34.771 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:34.810 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:34.945 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T18:47:34.954 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T18:47:34.964 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-23T18:47:34.972 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:34.982 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-23T18:47:35.011 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:35.020 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:35.184 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T18:47:35.212 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-23T18:47:35.250 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:35.314 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T18:47:35.329 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:35.358 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T18:47:35.372 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:35.383 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager. 2023-06-23T18:47:35.386 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-23T18:47:35.410 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:35.424 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:35.561 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package modemmanager. 2023-06-23T18:47:35.589 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:35.607 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T18:47:35.620 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:35.623 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:35.657 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:35.668 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T18:47:35.686 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-23T18:47:35.719 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:35.998 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ppp. 2023-06-23T18:47:36.022 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-23T18:47:36.056 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-23T18:47:36.084 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:36.122 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:36.138 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-23T18:47:36.142 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-23T18:47:36.143 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-23T18:47:36.149 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-23T18:47:36.150 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-23T18:47:36.160 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-23T18:47:36.164 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-23T18:47:36.181 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-23T18:47:36.212 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T18:47:36.239 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-23T18:47:36.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:36.301 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager. 2023-06-23T18:47:36.322 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:36.329 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:36.345 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-23T18:47:36.375 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-23T18:47:36.375 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:36.392 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:36.433 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:36.627 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T18:47:36.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2023-06-23T18:47:36.644 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libjson-perl. 2023-06-23T18:47:36.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-23T18:47:36.658 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:36.660 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-23T18:47:36.685 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:36.698 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:36.702 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-23T18:47:36.913 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T18:47:36.929 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-23T18:47:36.971 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:37.022 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-23T18:47:37.039 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-23T18:47:37.067 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-23T18:47:37.067 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-23T18:47:37.080 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:37.082 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ppp. 2023-06-23T18:47:37.094 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-23T18:47:37.110 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-23T18:47:37.171 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-23T18:47:37.180 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-23T18:47:37.181 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-23T18:47:37.182 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-23T18:47:37.183 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-23T18:47:37.209 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-23T18:47:37.213 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-23T18:47:37.274 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-23T18:47:37.296 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2023-06-23T18:47:37.302 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-23T18:47:37.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:37.349 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-common (238) ... 2023-06-23T18:47:37.363 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:37.398 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:37.603 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-23T18:47:37.630 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:37.669 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:37.720 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T18:47:37.748 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-23T18:47:37.786 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:37.927 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-23T18:47:37.979 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2023-06-23T18:47:38.006 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-23T18:47:38.010 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-23T18:47:38.010 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-23T18:47:38.011 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-23T18:47:38.014 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T18:47:38.039 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-23T18:47:38.081 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:38.100 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-23T18:47:38.106 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-23T18:47:38.174 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-common. 2023-06-23T18:47:38.190 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-23T18:47:38.242 INFO:teuthology.orchestra.run.smithi118.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-23T18:47:38.263 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-common (238) ... 2023-06-23T18:47:38.305 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:38.367 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-23T18:47:38.395 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-23T18:47:38.433 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-common (238) ... 2023-06-23T18:47:38.563 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-23T18:47:38.565 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-23T18:47:38.617 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T18:47:38.644 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-23T18:47:38.683 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-23T18:47:38.764 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-14. 2023-06-23T18:47:38.765 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:38.792 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:38.800 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T18:47:38.803 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:38.828 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:38.834 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:38.866 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:38.894 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T18:47:38.910 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-23T18:47:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:38.963 INFO:teuthology.orchestra.run.smithi164.stdout:Preconfiguring packages ... 2023-06-23T18:47:39.102 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T18:47:39.119 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:39.135 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-06-23T18:47:39.161 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:39.255 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-23T18:47:39.258 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package flex. 2023-06-23T18:47:39.283 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-23T18:47:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (238) ... 2023-06-23T18:47:39.354 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172970 files and directories currently installed.) 2023-06-23T18:47:39.360 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:39.392 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-common. 2023-06-23T18:47:39.406 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-23T18:47:39.420 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-23T18:47:39.477 INFO:teuthology.orchestra.run.smithi192.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-23T18:47:39.506 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-common (238) ... 2023-06-23T18:47:39.572 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T18:47:39.601 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:39.643 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-23T18:47:39.670 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:39.671 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:39.709 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:39.940 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:39.957 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-14. 2023-06-23T18:47:39.985 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:40.000 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T18:47:40.026 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:40.031 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-23T18:47:40.066 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:40.079 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-23T18:47:40.100 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql. 2023-06-23T18:47:40.129 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-23T18:47:40.208 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql (14+238) ... 2023-06-23T18:47:40.298 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2023-06-23T18:47:40.325 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-23T18:47:40.353 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T18:47:40.381 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:40.383 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-23T18:47:40.412 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (238) ... 2023-06-23T18:47:40.419 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:40.452 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client. 2023-06-23T18:47:40.479 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-23T18:47:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:40.518 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client (14+238) ... 2023-06-23T18:47:40.753 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-23T18:47:40.770 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-23T18:47:40.772 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-23T18:47:40.800 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:40.812 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-23T18:47:40.839 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:40.880 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-14. 2023-06-23T18:47:40.908 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:40.950 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package bison. 2023-06-23T18:47:41.090 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl8.6. 2023-06-23T18:47:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173043 files and directories currently installed.) 2023-06-23T18:47:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:41.159 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T18:47:41.187 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:41.225 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:41.268 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql. 2023-06-23T18:47:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-23T18:47:41.326 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql (14+238) ... 2023-06-23T18:47:41.409 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl. 2023-06-23T18:47:41.437 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-23T18:47:41.480 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-23T18:47:41.528 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T18:47:41.545 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client. 2023-06-23T18:47:41.556 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:41.561 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-23T18:47:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T18:47:41.594 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:41.595 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client (14+238) ... 2023-06-23T18:47:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-23T18:47:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:41.788 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-23T18:47:41.805 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-23T18:47:41.820 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T18:47:41.838 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-23T18:47:41.839 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T18:47:41.847 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-23T18:47:41.867 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:41.886 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:41.905 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:41.969 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package dump. 2023-06-23T18:47:41.997 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-23T18:47:42.035 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking dump (0.4b47-3) ... 2023-06-23T18:47:42.158 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package tcl8.6. 2023-06-23T18:47:42.186 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:42.224 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:42.240 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T18:47:42.256 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-23T18:47:42.298 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:42.324 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package indent. 2023-06-23T18:47:42.338 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-23T18:47:42.380 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-23T18:47:42.444 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T18:47:42.472 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-23T18:47:42.510 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:42.610 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T18:47:42.638 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-23T18:47:42.649 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T18:47:42.665 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-23T18:47:42.676 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:42.707 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:42.864 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package modemmanager. 2023-06-23T18:47:42.877 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package tcl. 2023-06-23T18:47:42.891 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:42.905 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-23T18:47:42.930 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:42.948 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-23T18:47:42.971 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-common (238) ... 2023-06-23T18:47:42.994 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T18:47:43.022 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-23T18:47:43.052 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2023-06-23T18:47:43.093 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-23T18:47:43.135 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (14+238) ... 2023-06-23T18:47:43.149 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-23T18:47:43.250 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:43.254 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T18:47:43.283 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-23T18:47:43.305 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T18:47:43.321 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-23T18:47:43.321 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:43.363 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:43.367 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:43.379 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2023-06-23T18:47:43.395 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-23T18:47:43.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (14+238) ... 2023-06-23T18:47:43.493 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:43.578 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package network-manager. 2023-06-23T18:47:43.606 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:43.614 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-23T18:47:43.619 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:43.631 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-23T18:47:43.653 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:43.667 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T18:47:43.673 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-23T18:47:43.683 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-23T18:47:43.708 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-23T18:47:43.725 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:43.735 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:43.774 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:43.992 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl8.6. 2023-06-23T18:47:44.020 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:44.027 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-23T18:47:44.054 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-23T18:47:44.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:44.093 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:44.095 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T18:47:44.123 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-23T18:47:44.186 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:44.210 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package ppp. 2023-06-23T18:47:44.238 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-23T18:47:44.248 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-23T18:47:44.329 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjson-perl. 2023-06-23T18:47:44.334 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:44.345 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-23T18:47:44.353 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl. 2023-06-23T18:47:44.369 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-23T18:47:44.379 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-23T18:47:44.417 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-23T18:47:44.474 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-common (238) ... 2023-06-23T18:47:44.498 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:44.691 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:44.691 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:44.692 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-23T18:47:44.706 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T18:47:44.732 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-23T18:47:44.734 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-23T18:47:44.760 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-23T18:47:44.764 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:44.807 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:44.818 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:44.873 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T18:47:44.902 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-23T18:47:44.948 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:44.952 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:45.053 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T18:47:45.118 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-23T18:47:45.160 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:45.179 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:45.200 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T18:47:45.225 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-23T18:47:45.259 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:45.263 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:45.305 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:45.389 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:45.515 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:45.520 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-23T18:47:45.547 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T18:47:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-23T18:47:45.575 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-23T18:47:45.587 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-client-common (238) ... 2023-06-23T18:47:45.622 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:45.641 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:45.774 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-23T18:47:45.784 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:45.869 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:45.908 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (238) ... 2023-06-23T18:47:45.909 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:45.916 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-23T18:47:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:45.982 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:46.011 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:46.119 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-23T18:47:46.245 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:46.245 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:46.254 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:46.397 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:46.523 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:46.543 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T18:47:46.571 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:46.604 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-common. 2023-06-23T18:47:46.610 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:46.633 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:46.633 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-23T18:47:46.641 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:46.689 INFO:teuthology.orchestra.run.smithi038.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-23T18:47:46.718 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-common (238) ... 2023-06-23T18:47:46.742 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:46.746 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:46.758 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up dump (0.4b47-3) ... 2023-06-23T18:47:46.852 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T18:47:46.873 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:46.918 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:46.920 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T18:47:46.937 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T18:47:46.987 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:46.998 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:47.113 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:47.125 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:47.161 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-14. 2023-06-23T18:47:47.190 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:47.231 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:47.242 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-23T18:47:47.245 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-23T18:47:47.250 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:47.331 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:47.355 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-23T18:47:47.368 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:47.398 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T18:47:47.426 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:47.473 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:47.477 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:47.480 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:47.571 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-23T18:47:47.632 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-23T18:47:47.660 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:47.660 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:47.758 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:47.901 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T18:47:47.928 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-23T18:47:47.943 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:47.976 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:48.068 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:48.141 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:48.186 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:48.218 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:48.250 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up dump (0.4b47-3) ... 2023-06-23T18:47:48.318 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:48.320 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T18:47:48.320 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client (14+238) ... 2023-06-23T18:47:48.327 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T18:47:48.348 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:48.386 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:48.393 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:48.419 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:48.422 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:48.506 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql. 2023-06-23T18:47:48.520 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:48.523 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-23T18:47:48.531 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:48.564 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql (14+238) ... 2023-06-23T18:47:48.645 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-23T18:47:48.655 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-23T18:47:48.657 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:48.672 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:48.714 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:48.771 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-23T18:47:48.783 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:48.791 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-client. 2023-06-23T18:47:48.808 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-23T18:47:48.850 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-client (14+238) ... 2023-06-23T18:47:48.906 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:48.909 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:48.917 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:48.918 INFO:teuthology.orchestra.run.smithi118.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T18:47:48.918 INFO:teuthology.orchestra.run.smithi118.stdout:which means they are currently configured by ifupdown: 2023-06-23T18:47:48.918 INFO:teuthology.orchestra.run.smithi118.stdout:- enp3s0f1 2023-06-23T18:47:48.919 INFO:teuthology.orchestra.run.smithi118.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T18:47:48.919 INFO:teuthology.orchestra.run.smithi118.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T18:47:48.919 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:49.004 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-23T18:47:49.040 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T18:47:49.066 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-23T18:47:49.066 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T18:47:49.093 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-23T18:47:49.095 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-23T18:47:49.142 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:49.160 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-23T18:47:49.192 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:49.368 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:49.405 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T18:47:49.461 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T18:47:49.471 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package tcl8.6. 2023-06-23T18:47:49.485 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:49.488 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:49.500 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:49.522 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:49.527 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:49.538 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:49.595 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:49.649 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b47-3) ... 2023-06-23T18:47:49.734 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T18:47:49.746 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client (14+238) ... 2023-06-23T18:47:49.754 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T18:47:49.755 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T18:47:49.770 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-23T18:47:49.782 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package tcl. 2023-06-23T18:47:49.800 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:49.804 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:49.810 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-23T18:47:49.853 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-23T18:47:49.872 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:50.161 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-23T18:47:50.202 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T18:47:50.230 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-23T18:47:50.268 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:50.282 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:50.286 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-23T18:47:50.308 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T18:47:50.335 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-23T18:47:50.374 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:50.407 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:50.407 INFO:teuthology.orchestra.run.smithi192.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T18:47:50.408 INFO:teuthology.orchestra.run.smithi192.stdout:which means they are currently configured by ifupdown: 2023-06-23T18:47:50.408 INFO:teuthology.orchestra.run.smithi192.stdout:- enp3s0f1 2023-06-23T18:47:50.408 INFO:teuthology.orchestra.run.smithi192.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T18:47:50.408 INFO:teuthology.orchestra.run.smithi192.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T18:47:50.408 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:50.425 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:50.437 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:50.528 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-23T18:47:50.532 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T18:47:50.551 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:50.598 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-23T18:47:50.631 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T18:47:50.659 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-23T18:47:50.677 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-common (238) ... 2023-06-23T18:47:50.697 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:50.698 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:50.727 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package modemmanager. 2023-06-23T18:47:50.755 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-23T18:47:50.794 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:50.842 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:50.891 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T18:47:50.968 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:51.009 INFO:teuthology.orchestra.run.smithi038.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T18:47:51.037 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-23T18:47:51.084 INFO:teuthology.orchestra.run.smithi038.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:51.094 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:51.222 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T18:47:51.262 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (14+238) ... 2023-06-23T18:47:51.355 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-client-common (238) ... 2023-06-23T18:47:51.383 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager. 2023-06-23T18:47:51.388 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:51.411 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-23T18:47:51.458 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:51.522 INFO:teuthology.orchestra.run.smithi118.stdout:Adding user postgres to group ssl-cert 2023-06-23T18:47:51.565 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-23T18:47:51.691 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:51.757 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:51.757 INFO:teuthology.orchestra.run.smithi118.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-23T18:47:51.774 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:51.817 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T18:47:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T18:47:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:51.942 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:51.943 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:47:51.944 INFO:teuthology.orchestra.run.smithi118.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-23T18:47:51.944 INFO:teuthology.orchestra.run.smithi118.stdout:Removing obsolete dictionary files: 2023-06-23T18:47:52.032 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T18:47:52.060 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:52.086 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:47:52.131 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ppp. 2023-06-23T18:47:52.159 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-23T18:47:52.169 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-common (238) ... 2023-06-23T18:47:52.229 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:52.383 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T18:47:52.448 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:52.551 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-23T18:47:52.727 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T18:47:52.733 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T18:47:52.744 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-23T18:47:52.777 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:52.834 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-23T18:47:52.926 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:52.961 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:52.988 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stdout:Adding user postgres to group ssl-cert 2023-06-23T18:47:53.004 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-23T18:47:53.038 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-23T18:47:53.269 INFO:teuthology.orchestra.run.smithi118.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-23T18:47:53.287 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-23T18:47:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:53.321 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:47:53.324 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-23T18:47:53.352 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-23T18:47:53.382 INFO:teuthology.orchestra.run.smithi118.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-23T18:47:53.382 INFO:teuthology.orchestra.run.smithi118.stdout:This user must also own the server process. 2023-06-23T18:47:53.382 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:53.382 INFO:teuthology.orchestra.run.smithi118.stdout:The database cluster will be initialized with locale "en_US". 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout:The default text search configuration will be set to "english". 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout:Data page checksums are disabled. 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:47:53.383 INFO:teuthology.orchestra.run.smithi118.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-23T18:47:53.384 INFO:teuthology.orchestra.run.smithi118.stdout:creating subdirectories ... ok 2023-06-23T18:47:53.384 INFO:teuthology.orchestra.run.smithi118.stdout:selecting dynamic shared memory implementation ... posix 2023-06-23T18:47:53.391 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-common (238) ... 2023-06-23T18:47:53.399 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default max_connections ... 100 2023-06-23T18:47:53.411 INFO:teuthology.orchestra.run.smithi192.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-23T18:47:53.411 INFO:teuthology.orchestra.run.smithi192.stdout:Removing obsolete dictionary files: 2023-06-23T18:47:53.419 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default shared_buffers ... 128MB 2023-06-23T18:47:53.424 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:53.429 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default time zone ... Etc/UTC 2023-06-23T18:47:53.430 INFO:teuthology.orchestra.run.smithi118.stdout:creating configuration files ... ok 2023-06-23T18:47:53.544 INFO:teuthology.orchestra.run.smithi118.stdout:running bootstrap script ... ok 2023-06-23T18:47:53.575 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:53.694 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-23T18:47:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:53.722 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:53.761 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:53.827 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (238) ... 2023-06-23T18:47:53.896 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:47:54.010 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-23T18:47:54.022 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:47:54.148 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:54.249 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-common. 2023-06-23T18:47:54.250 INFO:teuthology.orchestra.run.smithi118.stdout:performing post-bootstrap initialization ... ok 2023-06-23T18:47:54.274 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:47:54.277 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-23T18:47:54.326 INFO:teuthology.orchestra.run.smithi164.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-23T18:47:54.354 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-common (238) ... 2023-06-23T18:47:54.400 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:54.421 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:54.509 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:47:54.627 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:47:54.704 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2023-06-23T18:47:54.742 INFO:teuthology.orchestra.run.smithi192.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-23T18:47:54.764 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-14. 2023-06-23T18:47:54.765 INFO:teuthology.orchestra.run.smithi192.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-23T18:47:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-23T18:47:54.812 INFO:teuthology.orchestra.run.smithi192.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout:This user must also own the server process. 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout:The database cluster will be initialized with locale "en_US". 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout:The default text search configuration will be set to "english". 2023-06-23T18:47:54.813 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:54.814 INFO:teuthology.orchestra.run.smithi192.stdout:Data page checksums are disabled. 2023-06-23T18:47:54.814 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:47:54.814 INFO:teuthology.orchestra.run.smithi192.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-23T18:47:54.814 INFO:teuthology.orchestra.run.smithi192.stdout:creating subdirectories ... ok 2023-06-23T18:47:54.814 INFO:teuthology.orchestra.run.smithi192.stdout:selecting dynamic shared memory implementation ... posix 2023-06-23T18:47:54.826 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:54.828 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default max_connections ... 100 2023-06-23T18:47:54.848 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default shared_buffers ... 128MB 2023-06-23T18:47:54.863 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default time zone ... Etc/UTC 2023-06-23T18:47:54.864 INFO:teuthology.orchestra.run.smithi192.stdout:creating configuration files ... ok 2023-06-23T18:47:54.881 INFO:teuthology.orchestra.run.smithi118.stdout:syncing data to disk ... ok 2023-06-23T18:47:54.911 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:54.911 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-23T18:47:54.979 INFO:teuthology.orchestra.run.smithi192.stdout:running bootstrap script ... ok 2023-06-23T18:47:55.098 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-23T18:47:55.099 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2023-06-23T18:47:55.266 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:47:55.343 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-23T18:47:55.392 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up dump (0.4b47-3) ... 2023-06-23T18:47:55.477 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T18:47:55.535 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:55.611 INFO:teuthology.orchestra.run.smithi192.stdout:performing post-bootstrap initialization ... ok 2023-06-23T18:47:55.636 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:47:55.703 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-23T18:47:55.762 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-23T18:47:55.888 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-23T18:47:56.014 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:47:56.105 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-23T18:47:56.120 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:47:56.150 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql. 2023-06-23T18:47:56.174 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-23T18:47:56.180 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-23T18:47:56.300 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:56.312 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql (14+238) ... 2023-06-23T18:47:56.316 INFO:teuthology.orchestra.run.smithi192.stdout:syncing data to disk ... ok 2023-06-23T18:47:56.452 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-23T18:47:56.460 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:47:56.470 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-23T18:47:56.505 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-23T18:47:56.506 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2023-06-23T18:47:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:56.506 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2023-06-23T18:47:56.507 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-23T18:47:56.507 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2023-06-23T18:47:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2023-06-23T18:47:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:47:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-23T18:47:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2023-06-23T18:47:56.509 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2023-06-23T18:47:56.517 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2023-06-23T18:47:56.534 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2023-06-23T18:47:56.544 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2023-06-23T18:47:56.544 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2023-06-23T18:47:56.561 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:56.619 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-client. 2023-06-23T18:47:56.647 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-23T18:47:56.653 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2023-06-23T18:47:56.688 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-client (14+238) ... 2023-06-23T18:47:56.704 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-23T18:47:56.714 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-23T18:47:56.872 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-client (14+238) ... 2023-06-23T18:47:56.937 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-23T18:47:56.965 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-23T18:47:56.998 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:47:57.004 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-23T18:47:57.265 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl8.6. 2023-06-23T18:47:57.293 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-23T18:47:57.309 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2023-06-23T18:47:57.323 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:57.505 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:47:57.505 INFO:teuthology.orchestra.run.smithi038.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T18:47:57.505 INFO:teuthology.orchestra.run.smithi038.stdout:which means they are currently configured by ifupdown: 2023-06-23T18:47:57.505 INFO:teuthology.orchestra.run.smithi038.stdout:- ens1f0 2023-06-23T18:47:57.505 INFO:teuthology.orchestra.run.smithi038.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T18:47:57.506 INFO:teuthology.orchestra.run.smithi038.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T18:47:57.506 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:47:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package tcl. 2023-06-23T18:47:57.645 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-23T18:47:57.648 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T18:47:57.689 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-23T18:47:58.035 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T18:47:58.045 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T18:47:58.073 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-23T18:47:58.108 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2023-06-23T18:47:58.111 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:47:58.201 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:58.319 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-23T18:47:58.388 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T18:47:58.420 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql (14+238) ... 2023-06-23T18:47:58.457 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T18:47:58.474 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-23T18:47:58.507 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-23T18:47:58.529 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:58.530 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-23T18:47:58.647 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:47:58.835 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T18:47:58.863 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-23T18:47:58.898 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:47:58.898 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:47:58.910 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:47:58.950 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:47:59.067 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:47:59.203 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-23T18:47:59.238 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-common (238) ... 2023-06-23T18:47:59.321 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-common (238) ... 2023-06-23T18:47:59.432 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-23T18:47:59.499 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T18:47:59.535 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:59.653 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-23T18:47:59.711 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-23T18:47:59.779 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql (14+238) ... 2023-06-23T18:47:59.793 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:47:59.921 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:47:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:48:00.056 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:48:00.084 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:48:00.137 INFO:teuthology.orchestra.run.smithi038.stdout:Adding user postgres to group ssl-cert 2023-06-23T18:48:00.210 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-23T18:48:00.311 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:00.311 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:00.336 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-23T18:48:00.400 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:00.400 INFO:teuthology.orchestra.run.smithi038.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-23T18:48:00.462 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:48:00.609 INFO:teuthology.orchestra.run.smithi038.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-23T18:48:00.609 INFO:teuthology.orchestra.run.smithi038.stdout:Removing obsolete dictionary files: 2023-06-23T18:48:00.933 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T18:48:00.979 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-23T18:48:01.069 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-23T18:48:01.179 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-23T18:48:01.219 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:48:01.314 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-23T18:48:01.353 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:01.370 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:48:01.421 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-23T18:48:01.454 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:48:01.454 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T18:48:01.479 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-23T18:48:01.572 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:48:01.605 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (14+238) ... 2023-06-23T18:48:01.714 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:01.815 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:48:01.901 INFO:teuthology.orchestra.run.smithi038.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-23T18:48:01.916 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-23T18:48:01.952 INFO:teuthology.orchestra.run.smithi038.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout:This user must also own the server process. 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout:The database cluster will be initialized with locale "en_US". 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout:The default text search configuration will be set to "english". 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:01.953 INFO:teuthology.orchestra.run.smithi038.stdout:Data page checksums are disabled. 2023-06-23T18:48:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:01.954 INFO:teuthology.orchestra.run.smithi038.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-23T18:48:01.954 INFO:teuthology.orchestra.run.smithi038.stdout:creating subdirectories ... ok 2023-06-23T18:48:01.954 INFO:teuthology.orchestra.run.smithi038.stdout:selecting dynamic shared memory implementation ... posix 2023-06-23T18:48:01.967 INFO:teuthology.orchestra.run.smithi038.stdout:selecting default max_connections ... 100 2023-06-23T18:48:01.985 INFO:teuthology.orchestra.run.smithi038.stdout:selecting default shared_buffers ... 128MB 2023-06-23T18:48:01.996 INFO:teuthology.orchestra.run.smithi038.stdout:selecting default time zone ... Etc/UTC 2023-06-23T18:48:01.997 INFO:teuthology.orchestra.run.smithi038.stdout:creating configuration files ... ok 2023-06-23T18:48:01.997 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-23T18:48:02.047 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:02.047 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:02.052 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:48:02.054 DEBUG:teuthology.parallel:result is None 2023-06-23T18:48:02.108 INFO:teuthology.orchestra.run.smithi038.stdout:running bootstrap script ... ok 2023-06-23T18:48:02.148 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-23T18:48:02.291 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-23T18:48:02.417 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-23T18:48:02.551 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-23T18:48:02.673 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-23T18:48:02.677 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T18:48:02.736 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-23T18:48:02.753 INFO:teuthology.orchestra.run.smithi038.stdout:performing post-bootstrap initialization ... ok 2023-06-23T18:48:02.781 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-23T18:48:02.895 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-23T18:48:02.987 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:48:03.146 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:48:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:48:03.385 DEBUG:teuthology.parallel:result is None 2023-06-23T18:48:03.586 INFO:teuthology.orchestra.run.smithi038.stdout:syncing data to disk ... ok 2023-06-23T18:48:03.659 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-23T18:48:03.785 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up dump (0.4b47-3) ... 2023-06-23T18:48:03.887 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T18:48:03.961 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:48:04.013 INFO:teuthology.orchestra.run.smithi038.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-23T18:48:04.112 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-23T18:48:04.263 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-23T18:48:04.414 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-23T18:48:04.425 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-23T18:48:04.517 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-23T18:48:04.565 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-23T18:48:04.672 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-23T18:48:04.742 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-23T18:48:04.868 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-23T18:48:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:48:05.102 DEBUG:teuthology.parallel:result is None 2023-06-23T18:48:05.428 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-23T18:48:05.579 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:48:05.731 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-23T18:48:05.931 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-client (14+238) ... 2023-06-23T18:48:06.083 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-23T18:48:06.568 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:06.568 INFO:teuthology.orchestra.run.smithi164.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T18:48:06.568 INFO:teuthology.orchestra.run.smithi164.stdout:which means they are currently configured by ifupdown: 2023-06-23T18:48:06.568 INFO:teuthology.orchestra.run.smithi164.stdout:- enp3s0f1 2023-06-23T18:48:06.569 INFO:teuthology.orchestra.run.smithi164.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T18:48:06.569 INFO:teuthology.orchestra.run.smithi164.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T18:48:06.569 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T18:48:06.880 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:07.006 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-23T18:48:07.037 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T18:48:07.132 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up postgresql (14+238) ... 2023-06-23T18:48:07.258 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:07.376 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T18:48:07.401 INFO:teuthology.orchestra.run.smithi038.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:48:07.635 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:07.636 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:07.901 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-23T18:48:08.036 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-23T18:48:08.162 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-23T18:48:08.287 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T18:48:08.288 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-common (238) ... 2023-06-23T18:48:08.598 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:48:08.749 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:48:09.188 INFO:teuthology.orchestra.run.smithi164.stdout:Adding user postgres to group ssl-cert 2023-06-23T18:48:09.459 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:09.459 INFO:teuthology.orchestra.run.smithi164.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-23T18:48:09.656 INFO:teuthology.orchestra.run.smithi164.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-23T18:48:09.657 INFO:teuthology.orchestra.run.smithi164.stdout:Removing obsolete dictionary files: 2023-06-23T18:48:10.069 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-23T18:48:10.169 INFO:teuthology.orchestra.run.smithi038.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-23T18:48:10.243 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-23T18:48:10.648 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-23T18:48:10.814 INFO:teuthology.orchestra.run.smithi038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:48:10.817 DEBUG:teuthology.parallel:result is None 2023-06-23T18:48:11.000 INFO:teuthology.orchestra.run.smithi164.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-23T18:48:11.019 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout:This user must also own the server process. 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout:The database cluster will be initialized with locale "en_US". 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-23T18:48:11.060 INFO:teuthology.orchestra.run.smithi164.stdout:The default text search configuration will be set to "english". 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout:Data page checksums are disabled. 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout:creating subdirectories ... ok 2023-06-23T18:48:11.061 INFO:teuthology.orchestra.run.smithi164.stdout:selecting dynamic shared memory implementation ... posix 2023-06-23T18:48:11.073 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default max_connections ... 100 2023-06-23T18:48:11.093 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default shared_buffers ... 128MB 2023-06-23T18:48:11.103 INFO:teuthology.orchestra.run.smithi164.stdout:selecting default time zone ... Etc/UTC 2023-06-23T18:48:11.103 INFO:teuthology.orchestra.run.smithi164.stdout:creating configuration files ... ok 2023-06-23T18:48:11.213 INFO:teuthology.orchestra.run.smithi164.stdout:running bootstrap script ... ok 2023-06-23T18:48:11.849 INFO:teuthology.orchestra.run.smithi164.stdout:performing post-bootstrap initialization ... ok 2023-06-23T18:48:12.634 INFO:teuthology.orchestra.run.smithi164.stdout:syncing data to disk ... ok 2023-06-23T18:48:13.030 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-23T18:48:15.871 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:15.972 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-23T18:48:16.072 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up postgresql (14+238) ... 2023-06-23T18:48:16.198 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-23T18:48:16.324 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-23T18:48:16.579 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:16.580 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T18:48:17.185 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T18:48:17.504 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-23T18:48:17.655 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-23T18:48:19.183 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-23T18:48:19.308 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-23T18:48:19.912 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T18:48:19.914 DEBUG:teuthology.parallel:result is None 2023-06-23T18:48:19.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:48:20.140 DEBUG:teuthology.orchestra.run.smithi038:> dpkg-query -W -f '${Version}' ceph 2023-06-23T18:48:20.162 INFO:teuthology.orchestra.run.smithi038.stdout:18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.162 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.163 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479-g8627af3e-1jammy is installed. 2023-06-23T18:48:20.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:48:20.418 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2023-06-23T18:48:20.438 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.438 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.439 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479-g8627af3e-1jammy is installed. 2023-06-23T18:48:20.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:48:20.573 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2023-06-23T18:48:20.592 INFO:teuthology.orchestra.run.smithi118.stdout:18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.593 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.593 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479-g8627af3e-1jammy is installed. 2023-06-23T18:48:20.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:48:20.728 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-query -W -f '${Version}' ceph 2023-06-23T18:48:20.748 INFO:teuthology.orchestra.run.smithi164.stdout:18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.748 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.749 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479-g8627af3e-1jammy is installed. 2023-06-23T18:48:20.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:48:20.978 DEBUG:teuthology.orchestra.run.smithi192:> dpkg-query -W -f '${Version}' ceph 2023-06-23T18:48:20.998 INFO:teuthology.orchestra.run.smithi192.stdout:18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.998 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479-g8627af3e-1jammy 2023-06-23T18:48:20.999 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479-g8627af3e-1jammy is installed. 2023-06-23T18:48:20.999 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-23T18:48:21.000 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:21.000 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:48:21.015 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:21.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:48:21.030 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:21.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:48:21.045 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:21.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:48:21.059 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:21.060 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:48:21.074 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-23T18:48:21.074 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:21.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:48:21.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:48:21.144 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:21.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:48:21.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:48:21.217 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:21.218 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:48:21.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:48:21.283 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:21.284 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:48:21.298 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:48:21.353 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:21.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:48:21.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:48:21.421 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-23T18:48:21.421 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:21.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:48:21.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:48:21.492 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:21.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:48:21.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:48:21.562 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:21.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:48:21.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:48:21.627 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:21.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:48:21.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:48:21.698 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:21.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:48:21.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:48:21.764 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-23T18:48:21.764 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:21.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:48:21.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:48:21.831 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:21.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:48:21.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:48:21.897 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:21.898 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:48:21.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:48:21.964 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:21.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:48:21.978 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:48:22.033 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:22.034 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:48:22.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:48:22.104 INFO:teuthology.run_tasks:Running task ceph... 2023-06-23T18:48:22.178 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-23T18:48:22.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2023-06-23T18:48:22.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-06-23T18:48:22.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-06-23T18:48:22.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2023-06-23T18:48:22.188 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-06-23T18:48:22.201 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-23T18:48:22.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:48:22.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:48:22.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:48:22.241 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:48:22.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:48:22.255 INFO:tasks.ceph:Creating extra log directories... 2023-06-23T18:48:22.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:48:22.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:48:22.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:48:22.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:48:22.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:48:22.323 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-23T18:48:22.324 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-23T18:48:22.324 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-23T18:48:22.324 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:22.325 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:48:22.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:22.428 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:22.429 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:48:22.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:22.511 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:22.512 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:48:22.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:22.592 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:22.593 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:48:22.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:22.675 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:22.676 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:48:22.682 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:22.761 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-23T18:48:22.762 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-23T18:48:22.762 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'branch': 'wip-rishabh-improvements-authmon', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}', 'email': None, 'first_in_suite': False, 'job_id': '7313894', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-improvements-authmon'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-improvements-authmon', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-improvements-authmon', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPatyLVMjRsvi4ZOxM3cIu9GOmIfHEQpPSeyWPSio10NScSPoHcvBLS1RO/+tC7b1Di2ugncKIRfR7S9CzlZyIc=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSHSUYPJIubE2l3G3kyqCtHh49GXNywM8jRQqFQqkyZyd0zVdnKRFrgE9K/q0igKMwJYWSov4Mw0b7clTdlyjQ=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvoiJA5wTwxX7NHZ0F12F08/oGbPbEOm7EAOC6iyufkPO/FA9RVGUb/WluPfvCV+PZl07q0p41n4oVJC79LIdw=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG9x/7esvpDkOFFay+qKOPnOe9ucG7mskpW06HS/N5Mo/KffmVHugNmDMYxP2mhvdM3rX6WNVDTpDupMnTr+qw=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2KihXn35fSYKsF+1vyXgVxT/66bHjHwL5aChBkYAUeBX9A9ctnKD9ly24F073XN8AxUghHJ4ho2ezv6Bjz2iU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, {'ceph': None}, {'ceph-fuse': None}, {'pexec': {'clients': ['cd $TESTDIR', 'wget http://download.ceph.com/qa/mdtest-1.9.3.tgz', 'mkdir mdtest-1.9.3', 'cd mdtest-1.9.3', 'tar xvfz $TESTDIR/mdtest-1.9.3.tgz', 'rm $TESTDIR/mdtest-1.9.3.tgz', 'MPI_CC=mpicc make', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/mdtest-1.9.3', 'rm -rf $TESTDIR/._mdtest-1.9.3']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-23_17:37:30', 'tube': 'smithi', 'user': 'rishabh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-23T18:48:22.763 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:48:22.765 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:48:22.768 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:48:22.771 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:48:22.775 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:48:22.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:48:22.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:48:22.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:48:22.819 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:48:22.823 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:48:22.857 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:22.858 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:48:22.872 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:48:22.872 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 861 Links: 1 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-06-23 18:41:51.013381091 +0000 2023-06-23T18:48:22.920 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-06-23 18:41:50.653384306 +0000 2023-06-23T18:48:22.921 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-06-23 18:41:50.653384306 +0000 2023-06-23T18:48:22.921 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-06-23T18:48:22.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:48:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-06-23T18:48:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-06-23T18:48:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000581766 s, 880 kB/s 2023-06-23T18:48:22.976 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:48:23.025 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2023-06-23T18:48:23.072 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:48:23.072 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.072 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 878 Links: 1 2023-06-23T18:48:23.073 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.073 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-06-23 18:41:51.617375695 +0000 2023-06-23T18:48:23.073 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-06-23 18:41:51.261378875 +0000 2023-06-23T18:48:23.073 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-06-23 18:41:51.261378875 +0000 2023-06-23T18:48:23.074 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-06-23T18:48:23.074 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:48:23.126 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-06-23T18:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-06-23T18:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000479497 s, 1.1 MB/s 2023-06-23T18:48:23.127 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:48:23.178 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2023-06-23T18:48:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:48:23.224 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.224 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-06-23T18:48:23.224 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.224 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-06-23 18:41:51.845373659 +0000 2023-06-23T18:48:23.225 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-06-23 18:41:51.841373695 +0000 2023-06-23T18:48:23.225 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-06-23 18:41:51.841373695 +0000 2023-06-23T18:48:23.225 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-06-23T18:48:23.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:48:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-06-23T18:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-06-23T18:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000513342 s, 997 kB/s 2023-06-23T18:48:23.280 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:48:23.329 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 915 Links: 1 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-06-23 18:41:52.865364549 +0000 2023-06-23T18:48:23.376 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-06-23 18:41:52.489367907 +0000 2023-06-23T18:48:23.377 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-06-23 18:41:52.489367907 +0000 2023-06-23T18:48:23.377 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-06-23T18:48:23.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:48:23.430 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-06-23T18:48:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-06-23T18:48:23.431 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000471372 s, 1.1 MB/s 2023-06-23T18:48:23.432 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:48:23.480 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:23.481 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:23.481 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:48:23.487 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:48:23.487 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-06-23T18:48:23.535 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:48:23.535 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.535 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-06-23T18:48:23.535 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.536 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-23 18:41:51.111303658 +0000 2023-06-23T18:48:23.536 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-23 18:41:50.747306910 +0000 2023-06-23T18:48:23.536 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-23 18:41:50.747306910 +0000 2023-06-23T18:48:23.536 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-23T18:48:23.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:48:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-23T18:48:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-23T18:48:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000449341 s, 1.1 MB/s 2023-06-23T18:48:23.591 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:48:23.640 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-06-23T18:48:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:48:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.687 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-06-23T18:48:23.688 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.688 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-23 18:41:51.683298548 +0000 2023-06-23T18:48:23.688 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-23 18:41:51.347301550 +0000 2023-06-23T18:48:23.689 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-23 18:41:51.347301550 +0000 2023-06-23T18:48:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-23T18:48:23.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:48:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-23T18:48:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-23T18:48:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000368277 s, 1.4 MB/s 2023-06-23T18:48:23.742 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:48:23.792 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-06-23T18:48:23.838 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-23 18:41:52.255293440 +0000 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-23 18:41:51.923296406 +0000 2023-06-23T18:48:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-23 18:41:51.923296406 +0000 2023-06-23T18:48:23.840 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-23T18:48:23.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:48:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-23T18:48:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-23T18:48:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.0004184 s, 1.2 MB/s 2023-06-23T18:48:23.895 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:48:23.944 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-06-23T18:48:23.994 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-23 18:41:52.823288367 +0000 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-23 18:41:52.483291403 +0000 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-23 18:41:52.483291403 +0000 2023-06-23T18:48:23.995 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-23T18:48:23.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:48:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-23T18:48:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-23T18:48:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00042127 s, 1.2 MB/s 2023-06-23T18:48:24.050 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:48:24.101 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:24.101 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T18:48:24.101 INFO:tasks.ceph:Generating config... 2023-06-23T18:48:24.103 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-23T18:48:24.103 INFO:tasks.ceph:[client] debug client = 20 2023-06-23T18:48:24.104 INFO:tasks.ceph:[client] debug ms = 1 2023-06-23T18:48:24.104 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-23T18:48:24.104 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-23T18:48:24.104 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-23T18:48:24.105 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-23T18:48:24.105 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-23T18:48:24.105 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-23T18:48:24.105 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-23T18:48:24.105 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-23T18:48:24.106 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-23T18:48:24.106 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-23T18:48:24.106 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-23T18:48:24.107 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-23T18:48:24.107 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-23T18:48:24.107 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-23T18:48:24.107 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-23T18:48:24.107 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-23T18:48:24.108 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-23T18:48:24.108 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-23T18:48:24.108 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-23T18:48:24.108 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-06-23T18:48:24.108 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-23T18:48:24.109 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-23T18:48:24.109 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-23T18:48:24.109 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-23T18:48:24.109 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-23T18:48:24.110 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-23T18:48:24.110 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.110 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-23T18:48:24.110 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.110 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-23T18:48:24.111 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-23T18:48:24.111 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-23T18:48:24.111 INFO:tasks.ceph:Setting up mon.a... 2023-06-23T18:48:24.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-23T18:48:24.145 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2023-06-23T18:48:24.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-23T18:48:24.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:24.292 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '172.21.15.81'), ('mon.c', '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]')] 2023-06-23T18:48:24.293 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-23T18:48:24.294 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:24.294 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:48:24.340 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --add b 172.21.15.81 --addv c '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:24.428 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:24.428 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = pacific 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2023-06-23T18:48:24.429702+0000 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-06-23T18:48:24.429702+0000 2023-06-23T18:48:24.429 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 16 (pacific) 2023-06-23T18:48:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2023-06-23T18:48:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2023-06-23T18:48:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2023-06-23T18:48:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] mon.c 2023-06-23T18:48:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-23T18:48:24.431 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:48:24.476 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5... 2023-06-23T18:48:24.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:48:24.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:48:24.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:48:24.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:48:24.527 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:48:24.549 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2023-06-23T18:48:24.549 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2023-06-23T18:48:24.550 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.551 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:48:24.552 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2023-06-23T18:48:24.552 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.552 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:48:24.552 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:48:24.552 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:48:24.553 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:48:24.554 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2023-06-23T18:48:24.555 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.556 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.558 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.559 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2023-06-23T18:48:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:48:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2023-06-23T18:48:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore compression mode = aggressive 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 20 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 20 2023-06-23T18:48:24.561 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 10 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:48:24.562 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-06-23T18:48:24.563 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2023-06-23T18:48:24.564 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.565 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:48:24.566 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:48:24.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout: mon op complaint time = 120 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2023-06-23T18:48:24.568 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: client mount timeout = 600 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-06-23T18:48:24.569 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-06-23T18:48:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout:[mds] 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds = 20 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds balancer = 20 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug frag = True 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug scatterstat = True 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: mds op complaint time = 180 2023-06-23T18:48:24.571 INFO:teuthology.orchestra.run.smithi038.stdout: mds verify scatter = True 2023-06-23T18:48:24.572 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-06-23T18:48:24.572 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.572 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.575 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-06-23T18:48:24.575 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-06-23T18:48:24.575 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:48:24.575 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-06-23T18:48:24.576 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-06-23T18:48:24.577 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-06-23T18:48:24.578 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-06-23T18:48:24.580 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-23T18:48:24.581 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-06-23T18:48:24.582 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-06-23T18:48:24.583 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.584 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.585 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-06-23T18:48:24.586 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-06-23T18:48:24.586 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-06-23T18:48:24.586 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2023-06-23T18:48:24.587 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-06-23T18:48:24.587 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2023-06-23T18:48:24.587 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2023-06-23T18:48:24.587 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T18:48:24.588 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-06-23T18:48:24.588 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2023-06-23T18:48:24.588 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.588 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-06-23T18:48:24.589 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.589 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:48:24.589 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-06-23T18:48:24.590 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-06-23T18:48:24.590 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.590 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-06-23T18:48:24.590 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T18:48:24.591 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-06-23T18:48:24.591 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-06-23T18:48:24.591 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-06-23T18:48:24.592 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.592 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.592 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-06-23T18:48:24.593 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.593 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-06-23T18:48:24.593 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T18:48:24.593 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-06-23T18:48:24.593 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-06-23T18:48:24.594 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:48:24.595 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:48:24.596 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:48:24.597 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-06-23T18:48:24.598 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2023-06-23T18:48:24.599 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.600 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.601 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.602 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:48:24.603 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:48:24.604 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2023-06-23T18:48:24.605 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2023-06-23T18:48:24.607 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2023-06-23T18:48:24.608 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2023-06-23T18:48:24.609 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.610 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression mode = aggressive 2023-06-23T18:48:24.611 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.612 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2023-06-23T18:48:24.613 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2023-06-23T18:48:24.614 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2023-06-23T18:48:24.615 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:48:24.616 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.617 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2023-06-23T18:48:24.618 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-06-23T18:48:24.619 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2023-06-23T18:48:24.620 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2023-06-23T18:48:24.621 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-06-23T18:48:24.622 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.623 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:48:24.624 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.625 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-06-23T18:48:24.626 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:48:24.627 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:48:24.627 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-06-23T18:48:24.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.627 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:48:24.627 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-06-23T18:48:24.628 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-06-23T18:48:24.629 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-06-23T18:48:24.630 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-06-23T18:48:24.631 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.632 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore compression mode = aggressive 2023-06-23T18:48:24.633 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-06-23T18:48:24.634 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.635 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:48:24.635 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-06-23T18:48:24.635 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-06-23T18:48:24.635 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.635 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-06-23T18:48:24.636 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-06-23T18:48:24.636 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-06-23T18:48:24.636 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-06-23T18:48:24.637 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-06-23T18:48:24.637 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.637 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.638 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-06-23T18:48:24.638 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.638 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-06-23T18:48:24.639 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-06-23T18:48:24.639 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-06-23T18:48:24.639 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-06-23T18:48:24.640 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-06-23T18:48:24.640 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-06-23T18:48:24.640 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-06-23T18:48:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-06-23T18:48:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-06-23T18:48:24.641 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:48:24.642 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:48:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:48:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:48:24.643 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:48:24.644 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:48:24.644 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.644 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-06-23T18:48:24.644 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:48:24.645 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.645 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:48:24.645 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-06-23T18:48:24.646 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:48:24.646 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-06-23T18:48:24.646 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-06-23T18:48:24.646 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-06-23T18:48:24.647 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-06-23T18:48:24.648 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-06-23T18:48:24.649 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-06-23T18:48:24.650 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-06-23T18:48:24.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.652 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-06-23T18:48:24.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:48:24.654 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.655 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-06-23T18:48:24.656 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.38,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-06-23T18:48:24.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-06-23T18:48:24.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.659 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-06-23T18:48:24.659 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-06-23T18:48:24.659 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-06-23T18:48:24.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.659 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-06-23T18:48:24.660 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-06-23T18:48:24.660 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.660 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:48:24.660 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.660 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-06-23T18:48:24.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.663 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-06-23T18:48:24.664 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression mode = aggressive 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-23T18:48:24.665 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-06-23T18:48:24.666 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.667 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-06-23T18:48:24.668 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-06-23T18:48:24.669 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:48:24.670 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-06-23T18:48:24.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:48:24.672 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.673 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-06-23T18:48:24.674 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-06-23T18:48:24.674 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-06-23T18:48:24.674 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-06-23T18:48:24.674 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-06-23T18:48:24.674 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-06-23T18:48:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-06-23T18:48:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-06-23T18:48:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-23T18:48:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-06-23T18:48:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-06-23T18:48:24.676 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-06-23T18:48:24.676 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-06-23T18:48:24.676 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-06-23T18:48:24.676 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-06-23T18:48:24.677 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-06-23T18:48:24.677 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-23T18:48:24.678 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-23T18:48:24.732 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-23T18:48:24.732 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:24.733 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-23T18:48:24.738 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:24.738 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-23T18:48:24.783 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:48:24.784 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:24.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:48:24.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:24.852 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:24.852 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:24.900 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:48:24.900 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:24.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:48:24.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:24.923 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:48:24.923 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:24.971 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:48:24.972 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:24.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:48:24.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:24.996 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:48:24.996 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:25.044 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2023-06-23T18:48:25.045 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:25.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:48:25.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:25.069 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:48:25.069 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:25.114 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T18:48:25.115 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:25.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:48:25.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:48:25.140 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:48:25.140 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:25.185 INFO:tasks.ceph:Setting up mon nodes... 2023-06-23T18:48:25.186 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-23T18:48:25.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:48:25.230 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:48:25.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:48:25.276 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:48:25.287 INFO:tasks.ceph:Setting up mds nodes... 2023-06-23T18:48:25.287 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:48:25.333 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:48:25.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-23T18:48:25.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T18:48:25.390 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T18:48:25.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-23T18:48:25.446 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-23T18:48:25.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-23T18:48:25.481 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-23T18:48:25.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-23T18:48:25.548 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-23T18:48:25.572 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-23T18:48:25.606 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-23T18:48:25.628 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-23T18:48:25.629 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T18:48:25.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-23T18:48:25.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:25.644 INFO:tasks.ceph:role: osd.0 2023-06-23T18:48:25.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:48:25.645 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T18:48:25.727 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:25.728 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:25.729 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:25.729 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:25.729 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:27.026 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-06-23T18:48:27.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-06-23T18:48:27.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-23T18:48:27.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-23T18:48:27.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:27.153 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:27.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-23T18:48:27.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:27.207 INFO:tasks.ceph:role: osd.1 2023-06-23T18:48:27.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:48:27.207 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T18:48:27.290 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:27.290 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:27.290 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:27.290 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:27.290 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:27.291 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:27.291 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:27.291 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:27.291 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:27.291 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:28.584 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-06-23T18:48:28.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-06-23T18:48:28.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-23T18:48:28.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-23T18:48:28.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:28.710 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:28.710 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-23T18:48:28.764 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:28.764 INFO:tasks.ceph:role: osd.2 2023-06-23T18:48:28.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:48:28.765 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T18:48:28.847 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:28.847 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:28.847 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:28.848 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:28.848 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:28.848 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:28.848 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:28.848 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:28.849 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:28.849 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:30.152 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-06-23T18:48:30.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-06-23T18:48:30.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-23T18:48:30.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-23T18:48:30.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:30.264 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:30.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-23T18:48:30.316 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:30.317 INFO:tasks.ceph:role: osd.3 2023-06-23T18:48:30.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:48:30.317 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T18:48:30.400 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:30.400 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:30.401 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:30.401 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:30.401 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:30.401 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:30.402 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:30.402 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:30.402 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:30.402 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:31.716 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-06-23T18:48:31.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-06-23T18:48:31.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-23T18:48:31.779 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-23T18:48:31.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:31.834 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:31.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:31.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-23T18:48:31.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-23T18:48:31.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:48:31.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:48:31.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:48:31.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:31.949+0000 7f84e1f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-23T18:48:34.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-23T18:48:34.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:35.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-23T18:48:35.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-23T18:48:35.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:35.077+0000 7f3fffbb8640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-23T18:48:38.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-23T18:48:38.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:38.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-23T18:48:38.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-23T18:48:38.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:48:38.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:48:38.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:48:38.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:38.241+0000 7f0539ede640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-23T18:48:41.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-23T18:48:41.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-23T18:48:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-23T18:48:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:48:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:48:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:48:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:48:41.405+0000 7f94ecb8e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-23T18:48:44.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-23T18:48:44.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-23T18:48:44.503 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:44.503 INFO:tasks.ceph:role: osd.4 2023-06-23T18:48:44.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:48:44.504 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T18:48:44.567 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:44.567 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:44.567 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:44.567 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:44.567 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:44.568 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:44.568 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:44.568 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:44.568 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:44.568 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:45.024 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-23T18:48:45.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-23T18:48:45.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-23T18:48:45.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-23T18:48:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:45.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:45.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-23T18:48:45.184 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:45.185 INFO:tasks.ceph:role: osd.5 2023-06-23T18:48:45.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:48:45.185 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T18:48:45.245 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:45.246 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:45.247 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:45.247 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:45.247 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:45.715 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-23T18:48:45.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-23T18:48:45.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-23T18:48:45.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-23T18:48:45.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:45.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-23T18:48:45.928 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:45.928 INFO:tasks.ceph:role: osd.6 2023-06-23T18:48:45.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:48:45.929 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T18:48:45.990 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:45.990 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:45.991 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:45.992 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:46.485 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-23T18:48:46.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-23T18:48:46.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-23T18:48:46.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-23T18:48:46.647 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:46.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:46.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-23T18:48:46.701 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:48:46.702 INFO:tasks.ceph:role: osd.7 2023-06-23T18:48:46.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:48:46.702 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:48:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:48:46.764 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:48:46.764 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:48:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:48:46.764 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:48:47.183 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-23T18:48:47.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-23T18:48:47.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-23T18:48:47.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-23T18:48:47.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:48:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T18:48:47.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.411+0000 7fea3eb61640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-23T18:48:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.411+0000 7fea3eb61640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-23T18:48:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.411+0000 7fea3eb61640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:48:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.411+0000 7fea3eb61640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:48:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.411+0000 7fea3eb61640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:48:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:47.415+0000 7fea3eb61640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-23T18:48:50.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-23T18:48:50.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:50.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-23T18:48:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-23T18:48:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:48:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:48:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:48:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:50.522+0000 7f9c10d98640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-23T18:48:52.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:52.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:52.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:52.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:52.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:53.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-23T18:48:53.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.606+0000 7f9163e84640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-23T18:48:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.606+0000 7f9163e84640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-23T18:48:53.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.606+0000 7f9163e84640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.606+0000 7f9163e84640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.606+0000 7f9163e84640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:53.610+0000 7f9163e84640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-23T18:48:56.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-23T18:48:56.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:48:56.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-23T18:48:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-23T18:48:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:48:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:48:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:48:56.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:48:56.757+0000 7fdbb95a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-23T18:48:59.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-23T18:48:59.822 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-23T18:48:59.822 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:59.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-23T18:48:59.838 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:59.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-23T18:48:59.894 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:59.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-23T18:48:59.950 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:48:59.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-23T18:49:00.006 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:00.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-23T18:49:00.066 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:00.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-23T18:49:00.126 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-23T18:49:00.140 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-23T18:49:00.193 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-23T18:49:00.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-23T18:49:00.301 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-23T18:49:00.356 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:00.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-23T18:49:00.408 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:49:00.409 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-23T18:49:00.415 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:49:00.416 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-23T18:49:00.422 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:49:00.423 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-23T18:49:00.429 INFO:tasks.ceph:Adding keys to all mons... 2023-06-23T18:49:00.429 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T18:49:00.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T18:49:00.455 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2023-06-23T18:49:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVku/LpDRAAabjOaHYOKJbwcMkDg6fKng== 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVkc5MUFBAAg6Jha6S9Z0R05SlfSjuw3Q== 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD/6JVkePqvOBAAvx1dhMAN7DsWQkrS1+7drA== 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2023-06-23T18:49:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAD6ZVkFzC0BBAAYh8wS5mU1WysZgDIH3ODeg== 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAG6ZVk4uiHDhAAYMAHGZ4uwtWUvzGLX1+ssg== 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAJ6ZVkM6tQGBAA7RR9+4bcT4YJVPMEbLNg5Q== 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVkothgEBAAQkson6DDzcCq2Yfv2AcdpA== 2023-06-23T18:49:00.457 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVkNskyFxAATbtfkZRaBMGAXNPmj2EhzA== 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAP6ZVkyV+wGBAAB3DbeVaE800iLgNcd14ovA== 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAS6ZVkRCNpHxAA1qHcgFrJjZAeSy2O2Ebabw== 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2023-06-23T18:49:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAV6ZVk7hl4JBAAabDa87t15vI6unfJd4ujPQ== 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAY6ZVk2VVqLRAAmF0tGb1MeTnBtnhEmithvA== 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVk1mVMHBAAi93um2nEgTnMXfTAD6oZsw== 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVkTb6VIBAAhGCm6RhJeKkh+T+FTQizEg== 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout:[client.2] 2023-06-23T18:49:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQD56JVk77sTJBAALra1HBKTCqEGR8z2E7lFAg== 2023-06-23T18:49:00.463 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-06-23T18:49:00.463 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVku/LpDRAAabjOaHYOKJbwcMkDg6fKng== 2023-06-23T18:49:00.463 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVkc5MUFBAAg6Jha6S9Z0R05SlfSjuw3Q== 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD/6JVkePqvOBAAvx1dhMAN7DsWQkrS1+7drA== 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAD6ZVkFzC0BBAAYh8wS5mU1WysZgDIH3ODeg== 2023-06-23T18:49:00.464 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-06-23T18:49:00.465 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAG6ZVk4uiHDhAAYMAHGZ4uwtWUvzGLX1+ssg== 2023-06-23T18:49:00.465 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-06-23T18:49:00.465 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAJ6ZVkM6tQGBAA7RR9+4bcT4YJVPMEbLNg5Q== 2023-06-23T18:49:00.465 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-06-23T18:49:00.467 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVkothgEBAAQkson6DDzcCq2Yfv2AcdpA== 2023-06-23T18:49:00.467 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-06-23T18:49:00.467 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVkNskyFxAATbtfkZRaBMGAXNPmj2EhzA== 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAP6ZVkyV+wGBAAB3DbeVaE800iLgNcd14ovA== 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAS6ZVkRCNpHxAA1qHcgFrJjZAeSy2O2Ebabw== 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAV6ZVk7hl4JBAAabDa87t15vI6unfJd4ujPQ== 2023-06-23T18:49:00.468 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAY6ZVk2VVqLRAAmF0tGb1MeTnBtnhEmithvA== 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVk1mVMHBAAi93um2nEgTnMXfTAD6oZsw== 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVkTb6VIBAAhGCm6RhJeKkh+T+FTQizEg== 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-06-23T18:49:00.469 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD56JVk77sTJBAALra1HBKTCqEGR8z2E7lFAg== 2023-06-23T18:49:00.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:49:00.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:49:00.557 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:49:00.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:49:00.654 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:00.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:49:00.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:49:01.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:49:01.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:49:01.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:49:01.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.547 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:49:01.719 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-23T18:49:01.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-23T18:49:01.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:49:01.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-23T18:49:01.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-23T18:49:01.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:49:01.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-23T18:49:01.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-23T18:49:02.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:49:02.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-23T18:49:02.127 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:49:02.130 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:49:02.177 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-23T18:49:02.177 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-23T18:49:02.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-23T18:49:02.180 INFO:tasks.ceph.mon.a:Started 2023-06-23T18:49:02.181 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-23T18:49:02.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-23T18:49:02.223 INFO:tasks.ceph.mon.b:Started 2023-06-23T18:49:02.223 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-23T18:49:02.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-23T18:49:02.225 INFO:tasks.ceph.mon.c:Started 2023-06-23T18:49:02.226 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-23T18:49:02.226 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-23T18:49:02.226 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-23T18:49:02.229 INFO:tasks.ceph.mgr.y:Started 2023-06-23T18:49:02.229 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-23T18:49:02.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-23T18:49:02.232 INFO:tasks.ceph.mgr.x:Started 2023-06-23T18:49:02.232 INFO:tasks.ceph:Setting crush tunables to default 2023-06-23T18:49:02.232 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2023-06-23T18:49:02.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.354+0000 7f70f0998640 1 Processor -- start 2023-06-23T18:49:02.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.354+0000 7f70f0998640 1 -- start start 2023-06-23T18:49:02.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70f0998640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:02.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70f0998640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec14c290 con 0x7f70ec145f80 2023-06-23T18:49:02.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70f0998640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec06c960 con 0x7f70ec0b5e20 2023-06-23T18:49:02.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70f0998640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec14bf40 con 0x7f70ec14ce30 2023-06-23T18:49:02.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ea59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f70ec145f80 0x7f70ec069470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:59566/0 (socket says 172.21.15.38:59566) 2023-06-23T18:49:02.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 learned_addr learned my addr 172.21.15.38:0/3945845216 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:02.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:02.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:02.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.358+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.562+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.562+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.562+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.562+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.562+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:02.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.966+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:02.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.966+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:02.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.966+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:02.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.966+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:02.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:02.966+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:03.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:03.769+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:03.769+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:03.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:03.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T18:49:05.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 msgr2=0x7f70ec06c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:05.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70ec14ce30 0x7f70ec06c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:05.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v1:172.21.15.81:6789/0 conn(0x7f70ec0b5e20 legacy=0x7f70ec14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:05.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v1:172.21.15.38:6789/0 conn(0x7f70ec145f80 legacy=0x7f70ec069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:05.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec14bf40 con 0x7f70cc003720 2023-06-23T18:49:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc008db0 con 0x7f70cc006260 2023-06-23T18:49:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:05.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:05.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:05.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:05.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:05.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:06.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:06.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T18:49:06.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:06.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:06.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:06.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:06.769+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 msgr2=0x7f70cc0086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc006260 0x7f70cc0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 msgr2=0x7f70cc005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc003720 0x7f70cc005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:08.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 reap_dead start 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec070750 con 0x7f70cc003b20 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec14bf40 con 0x7f70cc009160 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc008db0 con 0x7f70cc007da0 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:08.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:08.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:08.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.357+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:08.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:08.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.561+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:08.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:08.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:08.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:08.965+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:49:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T18:49:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:49:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:09.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:09.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:09.769+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T18:49:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 msgr2=0x7f70cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:11.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70cc007da0 0x7f70cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 msgr2=0x7f70cc00b5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.38:3300/0 conn(0x7f70cc009160 0x7f70cc00b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 >> v1:172.21.15.81:6789/0 conn(0x7f70cc003b20 legacy=0x7f70cc006680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:11.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0089a0 con 0x7f70cc00dd10 2023-06-23T18:49:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e3fff640 1 -- 172.21.15.38:0/3945845216 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec14bf40 con 0x7f70cc011a40 2023-06-23T18:49:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:11.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:11.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:11.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:11.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.357+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:49:11.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:11.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.561+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:11.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.561+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:11.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:11.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.561+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T18:49:11.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.965+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T18:49:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.965+0000 7f70e9d9b640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:49:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:49:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:11.965+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T18:49:12.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.645+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10543221 0 0) 0x7f70cc0089a0 con 0x7f70cc00dd10 2023-06-23T18:49:12.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.645+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d8003530 con 0x7f70cc00dd10 2023-06-23T18:49:12.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349871742 0 0) 0x7f70d8003530 con 0x7f70cc00dd10 2023-06-23T18:49:12.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 msgr2=0x7f70cc013e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:12.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 --2- 172.21.15.38:0/3945845216 >> v2:172.21.15.81:3300/0 conn(0x7f70cc011a40 0x7f70cc013e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0154e0 con 0x7f70cc00dd10 2023-06-23T18:49:12.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f70e4001270 con 0x7f70cc00dd10 2023-06-23T18:49:12.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 >> v1:172.21.15.38:6789/0 conn(0x7f70cc00dd10 legacy=0x7f70cc010170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:12.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ead9d640 1 -- 172.21.15.38:0/3945845216 reap_dead start 2023-06-23T18:49:12.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 0x7f70d8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d80051f0 0x7f70d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec14bf40 con 0x7f70d8003980 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d800c130 con 0x7f70d80047d0 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d800c2f0 con 0x7f70d80051f0 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 0x7f70d8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70e9d9b640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ead9d640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d80051f0 0x7f70d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d80051f0 msgr2=0x7f70d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:12.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d80051f0 0x7f70d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 msgr2=0x7f70d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:12.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.649+0000 7f70ea59c640 1 -- 172.21.15.38:0/3945845216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8003530 con 0x7f70d8003980 2023-06-23T18:49:12.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70ea59c640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 0x7f70d8003d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006170 tx=0x7f70e401e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8901dfaf91f4ca server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:12.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b0400 con 0x7f70d8003980 2023-06-23T18:49:12.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40aa070 con 0x7f70d8003980 2023-06-23T18:49:12.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70e959a640 1 -- 172.21.15.38:0/3945845216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b07c0 con 0x7f70d8003980 2023-06-23T18:49:12.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 -- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 msgr2=0x7f70d8003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:12.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 0x7f70d8003d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70cc006170 tx=0x7f70e401e640 comp rx=0 tx=0).stop 2023-06-23T18:49:12.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 -- 172.21.15.38:0/3945845216 shutdown_connections 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d80051f0 0x7f70d800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 --2- 172.21.15.38:0/3945845216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d8003980 0x7f70d8003d70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 -- 172.21.15.38:0/3945845216 >> 172.21.15.38:0/3945845216 conn(0x7f70ec0c0f40 msgr2=0x7f70ec0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 -- 172.21.15.38:0/3945845216 shutdown_connections 2023-06-23T18:49:12.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.661+0000 7f70f0998640 1 -- 172.21.15.38:0/3945845216 wait complete. 2023-06-23T18:49:12.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 Processor -- start 2023-06-23T18:49:12.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- start start 2023-06-23T18:49:12.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70ec142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 0x7f70ec142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0993a0 con 0x7f70d80051f0 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec142fa0 con 0x7f70d80047d0 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0b7aa0 con 0x7f70d8003980 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ead9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 0x7f70ec142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70ec142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:12.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:59800/0 (socket says 172.21.15.38:59800) 2023-06-23T18:49:12.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70ec142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:37674/0 (socket says 172.21.15.38:37674) 2023-06-23T18:49:12.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 -- 172.21.15.38:0/2695035023 learned_addr learned my addr 172.21.15.38:0/2695035023 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:12.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ead9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 0x7f70ec142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49938/0 (socket says 172.21.15.38:49938) 2023-06-23T18:49:12.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 -- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 msgr2=0x7f70ec142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:12.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70ec142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 -- 172.21.15.38:0/2695035023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 msgr2=0x7f70ec142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:12.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 0x7f70ec142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 -- 172.21.15.38:0/2695035023 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec06f130 con 0x7f70d8003980 2023-06-23T18:49:12.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70ea59c640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c10 tx=0x7f70d8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:12.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40079f0 con 0x7f70d8003980 2023-06-23T18:49:12.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4001210 con 0x7f70d8003980 2023-06-23T18:49:12.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec098ce0 con 0x7f70d8003980 2023-06-23T18:49:12.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4005050 con 0x7f70d8003980 2023-06-23T18:49:12.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec0bcca0 con 0x7f70d8003980 2023-06-23T18:49:12.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70e40051b0 con 0x7f70d8003980 2023-06-23T18:49:12.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.665+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f70e40b9610 con 0x7f70d8003980 2023-06-23T18:49:12.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.669+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0bcca0 con 0x7f70d8003980 2023-06-23T18:49:12.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.677+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f70e40ac070 con 0x7f70d8003980 2023-06-23T18:49:12.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.741+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f70ec0bcca0 con 0x7f70d8003980 2023-06-23T18:49:12.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70e2ffd640 1 -- 172.21.15.38:0/2695035023 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f70e4007050 con 0x7f70d8003980 2023-06-23T18:49:12.756 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2023-06-23T18:49:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 msgr2=0x7f70ec0b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c10 tx=0x7f70d8005800 comp rx=0 tx=0).stop 2023-06-23T18:49:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 shutdown_connections 2023-06-23T18:49:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70d80051f0 0x7f70ec142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d80047d0 0x7f70ec142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 --2- 172.21.15.38:0/2695035023 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f70d8003980 0x7f70ec0b7560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 >> 172.21.15.38:0/2695035023 conn(0x7f70ec0c0f40 msgr2=0x7f70ec150030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 shutdown_connections 2023-06-23T18:49:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:12.753+0000 7f70f0998640 1 -- 172.21.15.38:0/2695035023 wait complete. 2023-06-23T18:49:12.776 INFO:tasks.ceph:check_enable_crimson: False 2023-06-23T18:49:12.777 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-23T18:49:12.777 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:12.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-23T18:49:12.788 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:12.789 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-23T18:49:12.844 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:12.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-23T18:49:12.895 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:12.893+0000 7fe65ced6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T18:49:12.897 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-06-23T18:49:12.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-23T18:49:12.934 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:12.923+0000 7f4e3c069180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T18:49:12.948 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:12.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-23T18:49:12.961 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:12.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-23T18:49:13.015 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:13.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-23T18:49:13.070 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-23T18:49:13.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-23T18:49:13.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 77559a57-3ed0-4210-9376-f6500d04bed9 0 2023-06-23T18:49:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.279+0000 7f1f4b5e1640 1 Processor -- start 2023-06-23T18:49:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.279+0000 7f1f4b5e1640 1 -- start start 2023-06-23T18:49:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4414e210 con 0x7f1f4406bce0 2023-06-23T18:49:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4414dbc0 con 0x7f1f440bc330 2023-06-23T18:49:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4414dea0 con 0x7f1f4414e6a0 2023-06-23T18:49:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f49b7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:52934/0 (socket says 172.21.15.81:52934) 2023-06-23T18:49:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 -- 172.21.15.81:0/893417741 learned_addr learned my addr 172.21.15.81:0/893417741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f49b7e640 1 --2- 172.21.15.81:0/893417741 >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50634/0 (socket says 172.21.15.81:50634) 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 -- 172.21.15.81:0/893417741 >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 msgr2=0x7f1f440bacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 --2- 172.21.15.81:0/893417741 >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 -- 172.21.15.81:0/893417741 >> v1:172.21.15.38:6789/0 conn(0x7f1f4406bce0 legacy=0x7f1f440bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 -- 172.21.15.81:0/893417741 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4406cf70 con 0x7f1f4414e6a0 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f49b7e640 1 --2- 172.21.15.81:0/893417741 >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f48b7c640 1 --2- 172.21.15.81:0/893417741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009870 tx=0x7f1f3401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e2994b45f571b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f3bfff640 1 -- 172.21.15.81:0/893417741 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340aa640 con 0x7f1f4414e6a0 2023-06-23T18:49:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f3bfff640 1 -- 172.21.15.81:0/893417741 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340aa7a0 con 0x7f1f4414e6a0 2023-06-23T18:49:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f3bfff640 1 -- 172.21.15.81:0/893417741 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340aab30 con 0x7f1f4414e6a0 2023-06-23T18:49:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/893417741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 msgr2=0x7f1f4406c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.283+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/893417741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009870 tx=0x7f1f3401c540 comp rx=0 tx=0).stop 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/893417741 shutdown_connections 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/893417741 >> v2:172.21.15.81:3300/0 conn(0x7f1f440bc330 0x7f1f440bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/893417741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f4406c0b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/893417741 >> 172.21.15.81:0/893417741 conn(0x7f1f440bd180 msgr2=0x7f1f440bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/893417741 shutdown_connections 2023-06-23T18:49:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/893417741 wait complete. 2023-06-23T18:49:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 Processor -- start 2023-06-23T18:49:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- start start 2023-06-23T18:49:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f440bc330 0x7f1f44070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f441413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441e3330 con 0x7f1f440bc330 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441e2a60 con 0x7f1f4406bce0 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441e2c70 con 0x7f1f4414e6a0 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f49b7e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f441413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50636/0 (socket says 172.21.15.81:50636) 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 -- 172.21.15.81:0/997697790 learned_addr learned my addr 172.21.15.81:0/997697790 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f48b7c640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f440bc330 0x7f1f44070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 -- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 msgr2=0x7f1f441413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f441413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 -- 172.21.15.81:0/997697790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f440bc330 msgr2=0x7f1f44070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f440bc330 0x7f1f44070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 -- 172.21.15.81:0/997697790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c00bc80 con 0x7f1f4406bce0 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f49b7e640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f441413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4937d640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c500 tx=0x7f1f4000c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400052d0 con 0x7f1f4406bce0 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40005430 con 0x7f1f4406bce0 2023-06-23T18:49:13.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f340094d0 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40003840 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f441400e0 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f40003ca0 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1f4001c780 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.287+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4404d790 con 0x7f1f4406bce0 2023-06-23T18:49:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.291+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1f40017070 con 0x7f1f4406bce0 2023-06-23T18:49:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.359+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "77559a57-3ed0-4210-9376-f6500d04bed9", "id": 0} v 0) v1 -- 0x7f1f440c03f0 con 0x7f1f4406bce0 2023-06-23T18:49:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f39ffb640 1 -- 172.21.15.81:0/997697790 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77559a57-3ed0-4210-9376-f6500d04bed9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f40011590 con 0x7f1f4406bce0 2023-06-23T18:49:13.381 INFO:teuthology.orchestra.run.smithi081.stdout:0 2023-06-23T18:49:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 msgr2=0x7f1f440705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c500 tx=0x7f1f4000c900 comp rx=0 tx=0).stop 2023-06-23T18:49:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 shutdown_connections 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f4414e6a0 0x7f1f441413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f440bc330 0x7f1f44070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 --2- 172.21.15.81:0/997697790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4406bce0 0x7f1f440705a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 >> 172.21.15.81:0/997697790 conn(0x7f1f440bd180 msgr2=0x7f1f4406c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 shutdown_connections 2023-06-23T18:49:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.371+0000 7f1f4b5e1640 1 -- 172.21.15.81:0/997697790 wait complete. 2023-06-23T18:49:13.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 8da635ff-1df9-4f93-bb2d-02c15192d51d 1 2023-06-23T18:49:13.405 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:13.401+0000 7fe65ced6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T18:49:13.482 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:13.471+0000 7f4e3c069180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T18:49:13.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.507+0000 7f6040cbb640 1 Processor -- start 2023-06-23T18:49:13.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.507+0000 7f6040cbb640 1 -- start start 2023-06-23T18:49:13.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 0x7f603c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c0b6d00 0x7f603c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f603c14f0e0 0x7f603c14a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c14e430 con 0x7f603c14f0e0 2023-06-23T18:49:13.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c14e710 con 0x7f603c0b6d00 2023-06-23T18:49:13.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6040cbb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14b090 con 0x7f603c0b7340 2023-06-23T18:49:13.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c0b6d00 0x7f603c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f603a59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 0x7f603c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c0b6d00 0x7f603c14eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50646/0 (socket says 172.21.15.81:50646) 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 -- 172.21.15.81:0/230073203 learned_addr learned my addr 172.21.15.81:0/230073203 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f603ad9d640 1 --2- 172.21.15.81:0/230073203 >> v2:172.21.15.38:3300/0 conn(0x7f603c14f0e0 0x7f603c14a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 -- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 msgr2=0x7f603c06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 0x7f603c06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 -- 172.21.15.81:0/230073203 >> v2:172.21.15.38:3300/0 conn(0x7f603c14f0e0 msgr2=0x7f603c14a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 --2- 172.21.15.81:0/230073203 >> v2:172.21.15.38:3300/0 conn(0x7f603c14f0e0 0x7f603c14a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f6039d9b640 1 -- 172.21.15.81:0/230073203 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0bd6a0 con 0x7f603c0b6d00 2023-06-23T18:49:13.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.511+0000 7f603a59c640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 0x7f603c06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6039d9b640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b6d00 0x7f603c14eba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f603c0c1b70 tx=0x7f603001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87fa5eb36cd79169 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f603959a640 1 -- 172.21.15.81:0/230073203 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300ab600 con 0x7f603c0b6d00 2023-06-23T18:49:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f603959a640 1 -- 172.21.15.81:0/230073203 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300a7050 con 0x7f603c0b6d00 2023-06-23T18:49:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f603959a640 1 -- 172.21.15.81:0/230073203 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300ab980 con 0x7f603c0b6d00 2023-06-23T18:49:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b6d00 msgr2=0x7f603c14eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b6d00 0x7f603c14eba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f603c0c1b70 tx=0x7f603001c3e0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- 172.21.15.81:0/230073203 shutdown_connections 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 --2- 172.21.15.81:0/230073203 >> v2:172.21.15.38:3300/0 conn(0x7f603c14f0e0 0x7f603c14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b6d00 0x7f603c14eba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 --2- 172.21.15.81:0/230073203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c0b7340 0x7f603c06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- 172.21.15.81:0/230073203 >> 172.21.15.81:0/230073203 conn(0x7f603c0c0f40 msgr2=0x7f603c0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- 172.21.15.81:0/230073203 shutdown_connections 2023-06-23T18:49:13.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- 172.21.15.81:0/230073203 wait complete. 2023-06-23T18:49:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 Processor -- start 2023-06-23T18:49:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.515+0000 7f6040cbb640 1 -- start start 2023-06-23T18:49:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f603c14f0e0 0x7f603c13de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 0x7f603c0ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1e7770 con 0x7f603c14f0e0 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14da00 con 0x7f603c0b7340 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14d690 con 0x7f603c13e570 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 0x7f603c0ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50662/0 (socket says 172.21.15.81:50662) 2023-06-23T18:49:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603a59c640 1 -- 172.21.15.81:0/317025182 learned_addr learned my addr 172.21.15.81:0/317025182 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6039d9b640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f603c14f0e0 0x7f603c13de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 -- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 msgr2=0x7f603c1e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 -- 172.21.15.81:0/317025182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f603c14f0e0 msgr2=0x7f603c13de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f603c14f0e0 0x7f603c13de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 -- 172.21.15.81:0/317025182 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009a70 con 0x7f603c13e570 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603a59c640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f603ad9d640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 0x7f603c0ba220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f602c00d4b0 tx=0x7f602c00d970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c018070 con 0x7f603c13e570 2023-06-23T18:49:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c004020 con 0x7f603c13e570 2023-06-23T18:49:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300094d0 con 0x7f603c13e570 2023-06-23T18:49:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0041b0 con 0x7f603c13e570 2023-06-23T18:49:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c14de90 con 0x7f603c13e570 2023-06-23T18:49:13.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f602c003620 con 0x7f603c13e570 2023-06-23T18:49:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f602c012d90 con 0x7f603c13e570 2023-06-23T18:49:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.519+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c13e3a0 con 0x7f603c13e570 2023-06-23T18:49:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.523+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f602c003a60 con 0x7f603c13e570 2023-06-23T18:49:13.595 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:13.593+0000 7fe65ced6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T18:49:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.591+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8da635ff-1df9-4f93-bb2d-02c15192d51d", "id": 1} v 0) v1 -- 0x7f603c14d850 con 0x7f603c13e570 2023-06-23T18:49:13.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f602affd640 1 -- 172.21.15.81:0/317025182 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8da635ff-1df9-4f93-bb2d-02c15192d51d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f602c003c00 con 0x7f603c13e570 2023-06-23T18:49:13.609 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-06-23T18:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 msgr2=0x7f603c0ba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 0x7f603c0ba220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f602c00d4b0 tx=0x7f602c00d970 comp rx=0 tx=0).stop 2023-06-23T18:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 shutdown_connections 2023-06-23T18:49:13.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f603c13e570 0x7f603c0ba220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f603c14f0e0 0x7f603c13de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 --2- 172.21.15.81:0/317025182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0b7340 0x7f603c1e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 >> 172.21.15.81:0/317025182 conn(0x7f603c0c0f40 msgr2=0x7f603c147ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 shutdown_connections 2023-06-23T18:49:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.599+0000 7f6040cbb640 1 -- 172.21.15.81:0/317025182 wait complete. 2023-06-23T18:49:13.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new f425f8c9-a012-421e-b499-1531b8eb349b 2 2023-06-23T18:49:13.687 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:13.679+0000 7f4e3c069180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T18:49:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 Processor -- start 2023-06-23T18:49:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 -- start start 2023-06-23T18:49:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59406dde0 con 0x7fc59414caa0 2023-06-23T18:49:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59406e0c0 con 0x7fc59414b970 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc599e39640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59406e9c0 con 0x7fc59406d620 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc592ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:52982/0 (socket says 172.21.15.81:52982) 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 -- 172.21.15.81:0/2181757158 learned_addr learned my addr 172.21.15.81:0/2181757158 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc592ffd640 1 --2- 172.21.15.81:0/2181757158 >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50664/0 (socket says 172.21.15.81:50664) 2023-06-23T18:49:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 -- 172.21.15.81:0/2181757158 >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 msgr2=0x7fc59406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 --2- 172.21.15.81:0/2181757158 >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 -- 172.21.15.81:0/2181757158 >> v1:172.21.15.38:6789/0 conn(0x7fc59414caa0 legacy=0x7fc5940704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc5937fe640 1 -- 172.21.15.81:0/2181757158 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59406e5e0 con 0x7fc59406d620 2023-06-23T18:49:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.739+0000 7fc592ffd640 1 --2- 172.21.15.81:0/2181757158 >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc5937fe640 1 --2- 172.21.15.81:0/2181757158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009870 tx=0x7fc58c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db723479dfe10ada server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc5927fc640 1 -- 172.21.15.81:0/2181757158 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0ac620 con 0x7fc59406d620 2023-06-23T18:49:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc5927fc640 1 -- 172.21.15.81:0/2181757158 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0ac780 con 0x7fc59406d620 2023-06-23T18:49:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc5927fc640 1 -- 172.21.15.81:0/2181757158 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0acb10 con 0x7fc59406d620 2023-06-23T18:49:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 -- 172.21.15.81:0/2181757158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 msgr2=0x7fc59414b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 --2- 172.21.15.81:0/2181757158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009870 tx=0x7fc58c01c4b0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 -- 172.21.15.81:0/2181757158 shutdown_connections 2023-06-23T18:49:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 --2- 172.21.15.81:0/2181757158 >> v2:172.21.15.81:3300/0 conn(0x7fc59414b970 0x7fc59406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 --2- 172.21.15.81:0/2181757158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc59414b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 -- 172.21.15.81:0/2181757158 >> 172.21.15.81:0/2181757158 conn(0x7fc5940c1fe0 msgr2=0x7fc5940c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 -- 172.21.15.81:0/2181757158 shutdown_connections 2023-06-23T18:49:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.743+0000 7fc599e39640 1 -- 172.21.15.81:0/2181757158 wait complete. 2023-06-23T18:49:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 Processor -- start 2023-06-23T18:49:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- start start 2023-06-23T18:49:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 0x7fc59406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc59414caa0 0x7fc5941e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59406a580 con 0x7fc59414caa0 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59406ab40 con 0x7fc59414b970 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940bdf70 con 0x7fc59406d620 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:52994/0 (socket says 172.21.15.81:52994) 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 -- 172.21.15.81:0/2169498529 learned_addr learned my addr 172.21.15.81:0/2169498529 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc592ffd640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 0x7fc59406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc593fff640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc59414caa0 0x7fc5941e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 -- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 msgr2=0x7fc59406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 0x7fc59406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 -- 172.21.15.81:0/2169498529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc59414caa0 msgr2=0x7fc5941e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc59414caa0 0x7fc5941e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 -- 172.21.15.81:0/2169498529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009420 con 0x7fc59406d620 2023-06-23T18:49:13.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc592ffd640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 0x7fc59406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc5937fe640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0af040 tx=0x7fc58c019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0b5440 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0b55a0 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0094d0 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0b5930 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59406b900 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc58c0b3070 con 0x7fc59406d620 2023-06-23T18:49:13.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc58c0ab3c0 con 0x7fc59406d620 2023-06-23T18:49:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.747+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59404d790 con 0x7fc59406d620 2023-06-23T18:49:13.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.751+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc58c0b9020 con 0x7fc59406d620 2023-06-23T18:49:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.819+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f425f8c9-a012-421e-b499-1531b8eb349b", "id": 2} v 0) v1 -- 0x7fc5940b7080 con 0x7fc59406d620 2023-06-23T18:49:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc57bfff640 1 -- 172.21.15.81:0/2169498529 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f425f8c9-a012-421e-b499-1531b8eb349b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc58c0b1070 con 0x7fc59406d620 2023-06-23T18:49:13.837 INFO:teuthology.orchestra.run.smithi081.stdout:2 2023-06-23T18:49:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 msgr2=0x7fc5940bda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0af040 tx=0x7fc58c019250 comp rx=0 tx=0).stop 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 shutdown_connections 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc59414caa0 0x7fc5941e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc59414b970 0x7fc59406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 --2- 172.21.15.81:0/2169498529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc59406d620 0x7fc5940bda30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 >> 172.21.15.81:0/2169498529 conn(0x7fc5940c1fe0 msgr2=0x7fc5941438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 shutdown_connections 2023-06-23T18:49:13.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.827+0000 7fc599e39640 1 -- 172.21.15.81:0/2169498529 wait complete. 2023-06-23T18:49:13.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 68c73311-17ba-4bbb-832d-094c342ee8a8 3 2023-06-23T18:49:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.955+0000 7f816e8c5640 1 Processor -- start 2023-06-23T18:49:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.955+0000 7f816e8c5640 1 -- start start 2023-06-23T18:49:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 0x7f816806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 0x7f81680bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816814e210 con 0x7f816814e6a0 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816814dbc0 con 0x7f816806bce0 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816814dea0 con 0x7f81680bc160 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f8167fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 0x7f816806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:53000/0 (socket says 172.21.15.81:53000) 2023-06-23T18:49:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 -- 172.21.15.81:0/3218547328 learned_addr learned my addr 172.21.15.81:0/3218547328 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f8167fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 0x7f816806c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50678/0 (socket says 172.21.15.81:50678) 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f81677fe640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 0x7f81680bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 -- 172.21.15.81:0/3218547328 >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 msgr2=0x7f816806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 0x7f816806c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 -- 172.21.15.81:0/3218547328 >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 msgr2=0x7f81680bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 0x7f81680bbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 -- 172.21.15.81:0/3218547328 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680bc570 con 0x7f81680bc160 2023-06-23T18:49:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f81677fe640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 0x7f81680bbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816ce62640 1 --2- 172.21.15.81:0/3218547328 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f816806c8e0 tx=0x7f816001ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d358401b405403ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f8166ffd640 1 -- 172.21.15.81:0/3218547328 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000a2d0 con 0x7f81680bc160 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f8166ffd640 1 -- 172.21.15.81:0/3218547328 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81600a7a10 con 0x7f81680bc160 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f8166ffd640 1 -- 172.21.15.81:0/3218547328 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81600a7da0 con 0x7f81680bc160 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- 172.21.15.81:0/3218547328 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 msgr2=0x7f81680bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- 172.21.15.81:0/3218547328 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f816806c8e0 tx=0x7f816001ebe0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- 172.21.15.81:0/3218547328 shutdown_connections 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- 172.21.15.81:0/3218547328 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f81680bc160 0x7f81680bacc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.38:3300/0 conn(0x7f816814e6a0 0x7f81680bbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 --2- 172.21.15.81:0/3218547328 >> v2:172.21.15.81:3300/0 conn(0x7f816806bce0 0x7f816806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- 172.21.15.81:0/3218547328 >> 172.21.15.81:0/3218547328 conn(0x7f81680bd180 msgr2=0x7f81680bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- 172.21.15.81:0/3218547328 shutdown_connections 2023-06-23T18:49:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.959+0000 7f816e8c5640 1 -- 172.21.15.81:0/3218547328 wait complete. 2023-06-23T18:49:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 Processor -- start 2023-06-23T18:49:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- start start 2023-06-23T18:49:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 0x7f81680b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81680b9ee0 con 0x7f816806bce0 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8168070200 con 0x7f81680bc160 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680b9000 con 0x7f816814e6a0 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f81677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:53004/0 (socket says 172.21.15.81:53004) 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f81677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50688/0 (socket says 172.21.15.81:50688) 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 -- 172.21.15.81:0/1564572222 learned_addr learned my addr 172.21.15.81:0/1564572222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8167fff640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 0x7f81680b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 -- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 msgr2=0x7f8168146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 -- 172.21.15.81:0/1564572222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 msgr2=0x7f81680b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 0x7f81680b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 -- 172.21.15.81:0/1564572222 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816000ac40 con 0x7f816814e6a0 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f81677fe640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8167fff640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 0x7f81680b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816ce62640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f816001f480 tx=0x7f816001b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160008700 con 0x7f816814e6a0 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160008860 con 0x7f816814e6a0 2023-06-23T18:49:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81680b73a0 con 0x7f816814e6a0 2023-06-23T18:49:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160008c10 con 0x7f816814e6a0 2023-06-23T18:49:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81680b9250 con 0x7f816814e6a0 2023-06-23T18:49:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8160003ca0 con 0x7f816814e6a0 2023-06-23T18:49:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f81600046b0 con 0x7f816814e6a0 2023-06-23T18:49:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.963+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81680b7530 con 0x7f816814e6a0 2023-06-23T18:49:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:13.967+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8160008dc0 con 0x7f816814e6a0 2023-06-23T18:49:14.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.035+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "68c73311-17ba-4bbb-832d-094c342ee8a8", "id": 3} v 0) v1 -- 0x7f816804d790 con 0x7f816814e6a0 2023-06-23T18:49:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f8164ff9640 1 -- 172.21.15.81:0/1564572222 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68c73311-17ba-4bbb-832d-094c342ee8a8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8160004130 con 0x7f816814e6a0 2023-06-23T18:49:14.053 INFO:teuthology.orchestra.run.smithi081.stdout:3 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 msgr2=0x7f81681e5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f816001f480 tx=0x7f816001b980 comp rx=0 tx=0).stop 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 shutdown_connections 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f816814e6a0 0x7f81681e5b90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81680bc160 0x7f8168146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 --2- 172.21.15.81:0/1564572222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816806bce0 0x7f81680b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 >> 172.21.15.81:0/1564572222 conn(0x7f81680bd180 msgr2=0x7f81680bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 shutdown_connections 2023-06-23T18:49:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.043+0000 7f816e8c5640 1 -- 172.21.15.81:0/1564572222 wait complete. 2023-06-23T18:49:14.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 499250a5-02f7-4465-9821-18e5228413bd 4 2023-06-23T18:49:14.170 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.165+0000 7fe65ced6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T18:49:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 Processor -- start 2023-06-23T18:49:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 -- start start 2023-06-23T18:49:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 0x7f748c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 0x7f748c133950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f748c06e5e0 0x7f748c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0713f0 con 0x7f748c0702a0 2023-06-23T18:49:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c152150 con 0x7f748c06e5e0 2023-06-23T18:49:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7492e5d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c152430 con 0x7f748c137260 2023-06-23T18:49:14.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f748c06e5e0 0x7f748c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f748bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 0x7f748c133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f748c06e5e0 0x7f748c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50700/0 (socket says 172.21.15.81:50700) 2023-06-23T18:49:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 -- 172.21.15.81:0/1646350613 learned_addr learned my addr 172.21.15.81:0/1646350613 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7490bf9640 1 --2- 172.21.15.81:0/1646350613 >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 0x7f748c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 -- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 msgr2=0x7f748c133950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 0x7f748c133950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 -- 172.21.15.81:0/1646350613 >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 msgr2=0x7f748c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 --2- 172.21.15.81:0/1646350613 >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 0x7f748c070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f74913fa640 1 -- 172.21.15.81:0/1646350613 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c136f80 con 0x7f748c06e5e0 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f7490bf9640 1 --2- 172.21.15.81:0/1646350613 >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 0x7f748c070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.171+0000 7f748bfff640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 0x7f748c133950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f74913fa640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c06e5e0 0x7f748c06a580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f748c0bfd10 tx=0x7f748401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f8979ee774923c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f748b7fe640 1 -- 172.21.15.81:0/1646350613 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840a5640 con 0x7f748c06e5e0 2023-06-23T18:49:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f748b7fe640 1 -- 172.21.15.81:0/1646350613 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840a57a0 con 0x7f748c06e5e0 2023-06-23T18:49:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f748b7fe640 1 -- 172.21.15.81:0/1646350613 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840a5b30 con 0x7f748c06e5e0 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 -- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c06e5e0 msgr2=0x7f748c06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c06e5e0 0x7f748c06a580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f748c0bfd10 tx=0x7f748401c8b0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 -- 172.21.15.81:0/1646350613 shutdown_connections 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c06e5e0 0x7f748c06a580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 --2- 172.21.15.81:0/1646350613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c137260 0x7f748c133950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 --2- 172.21.15.81:0/1646350613 >> v2:172.21.15.38:3300/0 conn(0x7f748c0702a0 0x7f748c070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 -- 172.21.15.81:0/1646350613 >> 172.21.15.81:0/1646350613 conn(0x7f748c0c1fe0 msgr2=0x7f748c0c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 -- 172.21.15.81:0/1646350613 shutdown_connections 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 -- 172.21.15.81:0/1646350613 wait complete. 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.175+0000 7f7492e5d640 1 Processor -- start 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- start start 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c06e5e0 0x7f748c1e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 0x7f748c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c150530 con 0x7f748c0702a0 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c130f90 con 0x7f748c137260 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c131fa0 con 0x7f748c06e5e0 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7490bf9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c06e5e0 0x7f748c1e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50716/0 (socket says 172.21.15.81:50716) 2023-06-23T18:49:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 -- 172.21.15.81:0/2795035056 learned_addr learned my addr 172.21.15.81:0/2795035056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f748bfff640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 0x7f748c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 -- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c06e5e0 msgr2=0x7f748c1e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c06e5e0 0x7f748c1e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 -- 172.21.15.81:0/2795035056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 msgr2=0x7f748c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 0x7f748c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 -- 172.21.15.81:0/2795035056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7478009420 con 0x7f748c137260 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f748bfff640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 0x7f748c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74913fa640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f748401af60 tx=0x7f7484019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840a5640 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840b88a0 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840b8c50 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7484009b30 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c151980 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f74840c1700 con 0x7f748c137260 2023-06-23T18:49:14.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f74840b6950 con 0x7f748c137260 2023-06-23T18:49:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.179+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c136d40 con 0x7f748c137260 2023-06-23T18:49:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.183+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f74840dfb00 con 0x7f748c137260 2023-06-23T18:49:14.226 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.221+0000 7fe65ced6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T18:49:14.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.247+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "499250a5-02f7-4465-9821-18e5228413bd", "id": 4} v 0) v1 -- 0x7f748c132110 con 0x7f748c137260 2023-06-23T18:49:14.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f74897fa640 1 -- 172.21.15.81:0/2795035056 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "499250a5-02f7-4465-9821-18e5228413bd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f74840ce030 con 0x7f748c137260 2023-06-23T18:49:14.265 INFO:teuthology.orchestra.run.smithi081.stdout:4 2023-06-23T18:49:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 msgr2=0x7f748c132ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f748401af60 tx=0x7f7484019650 comp rx=0 tx=0).stop 2023-06-23T18:49:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 shutdown_connections 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748c137260 0x7f748c132ce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f748c0702a0 0x7f748c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 --2- 172.21.15.81:0/2795035056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f748c06e5e0 0x7f748c1e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 >> 172.21.15.81:0/2795035056 conn(0x7f748c0c1fe0 msgr2=0x7f748c12fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 shutdown_connections 2023-06-23T18:49:14.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.255+0000 7f7492e5d640 1 -- 172.21.15.81:0/2795035056 wait complete. 2023-06-23T18:49:14.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new d249bd2b-827b-4d00-8998-325cfac702bc 5 2023-06-23T18:49:14.280 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.277+0000 7fe65ced6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T18:49:14.283 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.275+0000 7f4e3c069180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T18:49:14.339 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.331+0000 7f4e3c069180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T18:49:14.361 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.357+0000 7fe65ced6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T18:49:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 Processor -- start 2023-06-23T18:49:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 -- start start 2023-06-23T18:49:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8404145f80 0x7f840406c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 0x7f8404069470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840414c290 con 0x7f84040699b0 2023-06-23T18:49:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840406c960 con 0x7f84040b5e20 2023-06-23T18:49:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f8408ccb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840414bf40 con 0x7f8404145f80 2023-06-23T18:49:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.379+0000 7f840259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8404145f80 0x7f840406c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8404145f80 0x7f840406c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50724/0 (socket says 172.21.15.81:50724) 2023-06-23T18:49:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 -- 172.21.15.81:0/588701537 learned_addr learned my addr 172.21.15.81:0/588701537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8401d9b640 1 --2- 172.21.15.81:0/588701537 >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 0x7f8404069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 -- 172.21.15.81:0/588701537 >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 msgr2=0x7f8404069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 --2- 172.21.15.81:0/588701537 >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 0x7f8404069470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 -- 172.21.15.81:0/588701537 >> v1:172.21.15.81:6789/0 conn(0x7f84040699b0 legacy=0x7f840414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 -- 172.21.15.81:0/588701537 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404070750 con 0x7f8404145f80 2023-06-23T18:49:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840159a640 1 -- 172.21.15.81:0/588701537 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703126346 0 0) 0x7f840414c290 con 0x7f84040699b0 2023-06-23T18:49:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8401d9b640 1 --2- 172.21.15.81:0/588701537 >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 0x7f8404069470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:14.394 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f4e3c069180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T18:49:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840259c640 1 --2- 172.21.15.81:0/588701537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f840406c2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84040c1b10 tx=0x7f83f801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=716fd42183e232c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840159a640 1 -- 172.21.15.81:0/588701537 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80ac600 con 0x7f8404145f80 2023-06-23T18:49:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840159a640 1 -- 172.21.15.81:0/588701537 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80a8050 con 0x7f8404145f80 2023-06-23T18:49:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f840159a640 1 -- 172.21.15.81:0/588701537 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80ac980 con 0x7f8404145f80 2023-06-23T18:49:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 -- 172.21.15.81:0/588701537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 msgr2=0x7f840406c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 --2- 172.21.15.81:0/588701537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f840406c2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f84040c1b10 tx=0x7f83f801c380 comp rx=0 tx=0).stop 2023-06-23T18:49:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 -- 172.21.15.81:0/588701537 shutdown_connections 2023-06-23T18:49:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 --2- 172.21.15.81:0/588701537 >> v2:172.21.15.38:3300/0 conn(0x7f84040b5e20 0x7f8404069470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 --2- 172.21.15.81:0/588701537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f840406c2f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 -- 172.21.15.81:0/588701537 >> 172.21.15.81:0/588701537 conn(0x7f84040c0f40 msgr2=0x7f84040c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 -- 172.21.15.81:0/588701537 shutdown_connections 2023-06-23T18:49:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.383+0000 7f8408ccb640 1 -- 172.21.15.81:0/588701537 wait complete. 2023-06-23T18:49:14.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 Processor -- start 2023-06-23T18:49:14.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- start start 2023-06-23T18:49:14.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84040b5e20 0x7f8404155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040bbee0 con 0x7f84040b5e20 2023-06-23T18:49:14.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840413f4c0 con 0x7f8404145f80 2023-06-23T18:49:14.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040b8a20 con 0x7f84040699b0 2023-06-23T18:49:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8402d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8402d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50736/0 (socket says 172.21.15.81:50736) 2023-06-23T18:49:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8402d9d640 1 -- 172.21.15.81:0/1292385378 learned_addr learned my addr 172.21.15.81:0/1292385378 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:53030/0 (socket says 172.21.15.81:53030) 2023-06-23T18:49:14.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8401d9b640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84040b5e20 0x7f8404155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 -- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 msgr2=0x7f8404156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 -- 172.21.15.81:0/1292385378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84040b5e20 msgr2=0x7f8404155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84040b5e20 0x7f8404155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 -- 172.21.15.81:0/1292385378 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80094d0 con 0x7f84040699b0 2023-06-23T18:49:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8402d9d640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f840259c640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f83f80ac000 tx=0x7f83f801ac20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80b7650 con 0x7f84040699b0 2023-06-23T18:49:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80b77b0 con 0x7f84040699b0 2023-06-23T18:49:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840406f130 con 0x7f84040699b0 2023-06-23T18:49:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80b7b60 con 0x7f84040699b0 2023-06-23T18:49:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84040bc390 con 0x7f84040699b0 2023-06-23T18:49:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83f80b3070 con 0x7f84040699b0 2023-06-23T18:49:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f83f80c0db0 con 0x7f84040699b0 2023-06-23T18:49:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.387+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840404d790 con 0x7f84040699b0 2023-06-23T18:49:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.391+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f83f80deb00 con 0x7f84040699b0 2023-06-23T18:49:14.416 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.413+0000 7fe65ced6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T18:49:14.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.455+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d249bd2b-827b-4d00-8998-325cfac702bc", "id": 5} v 0) v1 -- 0x7f840406c0d0 con 0x7f84040699b0 2023-06-23T18:49:14.472 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f4e3c069180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T18:49:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f83f2ffd640 1 -- 172.21.15.81:0/1292385378 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d249bd2b-827b-4d00-8998-325cfac702bc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83f80cd030 con 0x7f84040699b0 2023-06-23T18:49:14.473 INFO:teuthology.orchestra.run.smithi081.stdout:5 2023-06-23T18:49:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 msgr2=0x7f84040ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f83f80ac000 tx=0x7f83f801ac20 comp rx=0 tx=0).stop 2023-06-23T18:49:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 shutdown_connections 2023-06-23T18:49:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8404145f80 0x7f8404156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84040b5e20 0x7f8404155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 --2- 172.21.15.81:0/1292385378 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84040699b0 0x7f84040ba530 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 >> 172.21.15.81:0/1292385378 conn(0x7f84040c0f40 msgr2=0x7f84040c1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 shutdown_connections 2023-06-23T18:49:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.463+0000 7f8408ccb640 1 -- 172.21.15.81:0/1292385378 wait complete. 2023-06-23T18:49:14.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 901d85cc-2b2b-457d-b22f-616ce27eab98 6 2023-06-23T18:49:14.495 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.493+0000 7fe65ced6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T18:49:14.525 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.515+0000 7f4e3c069180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T18:49:14.549 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.545+0000 7fe65ced6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T18:49:14.604 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.595+0000 7f4e3c069180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T18:49:14.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.619+0000 7fdabcc9b640 1 Processor -- start 2023-06-23T18:49:14.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.619+0000 7fdabcc9b640 1 -- start start 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdabcc9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdab80696d0 0x7fdab814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdabcc9b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80b6270 con 0x7fdab80712c0 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdabcc9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80709c0 con 0x7fdab80b6490 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdabcc9b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab8071110 con 0x7fdab80696d0 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab6d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdab80b6490 0x7fdab80b6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38186/0 (socket says 172.21.15.81:38186) 2023-06-23T18:49:14.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab6d9d640 1 -- 172.21.15.81:0/3448943130 learned_addr learned my addr 172.21.15.81:0/3448943130 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-06-23T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 --2- 172.21.15.81:0/3448943130 >> v2:172.21.15.38:3300/0 conn(0x7fdab80696d0 0x7fdab814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838875644 0 0) 0x7fdab80709c0 con 0x7fdab80b6490 2023-06-23T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa4003530 con 0x7fdab80b6490 2023-06-23T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264583024 0 0) 0x7fdaa4003530 con 0x7fdab80b6490 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 >> v2:172.21.15.38:3300/0 conn(0x7fdab80696d0 msgr2=0x7fdab814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 --2- 172.21.15.81:0/3448943130 >> v2:172.21.15.38:3300/0 conn(0x7fdab80696d0 0x7fdab814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 >> v1:172.21.15.38:6789/0 conn(0x7fdab80712c0 legacy=0x7fdab814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8070d70 con 0x7fdab80b6490 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fdab0001a00 con 0x7fdab80b6490 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 >> v1:172.21.15.81:6789/0 conn(0x7fdab80b6490 legacy=0x7fdab80b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 0x7fdaa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa40047d0 0x7fdaa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdaa4005180 0x7fdaa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8071110 con 0x7fdaa40047d0 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa400bfe0 con 0x7fdaa4003980 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa400c1a0 con 0x7fdaa4005180 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 0x7fdaa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdaaffff640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa40047d0 0x7fdaa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab6d9d640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdaa4005180 0x7fdaa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 -- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdaa4005180 msgr2=0x7fdaa400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdaa4005180 0x7fdaa400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 -- 172.21.15.81:0/3448943130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa40047d0 msgr2=0x7fdaa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa40047d0 0x7fdaa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 -- 172.21.15.81:0/3448943130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4003530 con 0x7fdaa4003980 2023-06-23T18:49:14.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab6d9d640 1 -- 172.21.15.81:0/3448943130 reap_dead start 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab659c640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 0x7fdaa4003d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009ae0 tx=0x7fdaa801ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a07e828f2186ffb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80a5640 con 0x7fdaa4003980 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80a57a0 con 0x7fdaa4003980 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.623+0000 7fdab5d9b640 1 -- 172.21.15.81:0/3448943130 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80a5b50 con 0x7fdaa4003980 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 msgr2=0x7fdaa4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 0x7fdaa4003d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009ae0 tx=0x7fdaa801ca50 comp rx=0 tx=0).stop 2023-06-23T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/3448943130 shutdown_connections 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/3448943130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa4003980 0x7fdaa4003d90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/3448943130 >> 172.21.15.81:0/3448943130 conn(0x7fdab80c0f40 msgr2=0x7fdab80c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/3448943130 shutdown_connections 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/3448943130 wait complete. 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 Processor -- start 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- start start 2023-06-23T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa4003980 0x7fdab8148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdab81d8f60 0x7fdab80c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80c0ce0 con 0x7fdaa4003980 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8148340 con 0x7fdab81e6330 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab81e67d0 con 0x7fdab81d8f60 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdab81d8f60 0x7fdab80c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50750/0 (socket says 172.21.15.81:50750) 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 -- 172.21.15.81:0/4086744465 learned_addr learned my addr 172.21.15.81:0/4086744465 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab659c640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa4003980 0x7fdab8148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 -- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdab81d8f60 msgr2=0x7fdab80c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdab81d8f60 0x7fdab80c07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 -- 172.21.15.81:0/4086744465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa4003980 msgr2=0x7fdab8148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa4003980 0x7fdab8148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 -- 172.21.15.81:0/4086744465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab81e6990 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdab6d9d640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdab80bbfa0 tx=0x7fdab0007a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0010510 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0010670 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab8147b40 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0010a00 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8147fc0 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdab0014480 con 0x7fdab81e6330 2023-06-23T18:49:14.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.627+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fdab001d9a0 con 0x7fdab81e6330 2023-06-23T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.631+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab81d8710 con 0x7fdab81e6330 2023-06-23T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.631+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdab81d8710 con 0x7fdab81e6330 2023-06-23T18:49:14.659 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.651+0000 7f4e3c069180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T18:49:14.694 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.688+0000 7fe65ced6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T18:49:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.695+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "901d85cc-2b2b-457d-b22f-616ce27eab98", "id": 6} v 0) v1 -- 0x7fdab804d790 con 0x7fdab81e6330 2023-06-23T18:49:14.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdaaeffd640 1 -- 172.21.15.81:0/4086744465 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "901d85cc-2b2b-457d-b22f-616ce27eab98", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdab0019070 con 0x7fdab81e6330 2023-06-23T18:49:14.712 INFO:teuthology.orchestra.run.smithi081.stdout:6 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 msgr2=0x7fdab8147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdab80bbfa0 tx=0x7fdab0007a20 comp rx=0 tx=0).stop 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 shutdown_connections 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdab81e6330 0x7fdab8147600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdab81d8f60 0x7fdab80c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 --2- 172.21.15.81:0/4086744465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa4003980 0x7fdab8148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 >> 172.21.15.81:0/4086744465 conn(0x7fdab80c0f40 msgr2=0x7fdab814a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 shutdown_connections 2023-06-23T18:49:14.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.703+0000 7fdabcc9b640 1 -- 172.21.15.81:0/4086744465 wait complete. 2023-06-23T18:49:14.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 5a50352f-25ca-4116-b04f-bbd2400a26b9 7 2023-06-23T18:49:14.756 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:14.752+0000 7fe65ced6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T18:49:14.802 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.791+0000 7f4e3c069180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T18:49:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 Processor -- start 2023-06-23T18:49:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 -- start start 2023-06-23T18:49:14.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdea80b7360 0x7fdea80b7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea806de70 con 0x7fdea806e770 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea806e110 con 0x7fdea814c080 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeafc7f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea806e3f0 con 0x7fdea80b7360 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeada1b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdea814c080 0x7fdea814c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38190/0 (socket says 172.21.15.81:38190) 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.827+0000 7fdeada1b640 1 -- 172.21.15.81:0/4227704456 learned_addr learned my addr 172.21.15.81:0/4227704456 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-06-23T18:49:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 --2- 172.21.15.81:0/4227704456 >> v2:172.21.15.38:3300/0 conn(0x7fdea80b7360 0x7fdea80b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168704614 0 0) 0x7fdea806e110 con 0x7fdea814c080 2023-06-23T18:49:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde94003530 con 0x7fdea814c080 2023-06-23T18:49:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698486687 0 0) 0x7fde94003530 con 0x7fdea814c080 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 >> v2:172.21.15.38:3300/0 conn(0x7fdea80b7360 msgr2=0x7fdea80b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 --2- 172.21.15.81:0/4227704456 >> v2:172.21.15.38:3300/0 conn(0x7fdea80b7360 0x7fdea80b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 >> v1:172.21.15.38:6789/0 conn(0x7fdea806e770 legacy=0x7fdea8131870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea814cb60 con 0x7fdea814c080 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fdea4001680 con 0x7fdea814c080 2023-06-23T18:49:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 >> v1:172.21.15.81:6789/0 conn(0x7fdea814c080 legacy=0x7fdea814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde94003980 0x7fde94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde940047d0 0x7fde94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 0x7fde9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea806e3f0 con 0x7fde94003980 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9400c000 con 0x7fde94005180 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9400c1c0 con 0x7fde940047d0 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 0x7fde9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdead21a640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde940047d0 0x7fde94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeada1b640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde94003980 0x7fde94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 -- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde940047d0 msgr2=0x7fde94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde940047d0 0x7fde94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 -- 172.21.15.81:0/4227704456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde94003980 msgr2=0x7fde94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde94003980 0x7fde94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 -- 172.21.15.81:0/4227704456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94003530 con 0x7fde94005180 2023-06-23T18:49:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeada1b640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde94003980 0x7fde94003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 -- 172.21.15.81:0/4227704456 reap_dead start 2023-06-23T18:49:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeae21c640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 0x7fde9400b990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009fc0 tx=0x7fdea001cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3697a31c604d7709 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0003ba0 con 0x7fde94005180 2023-06-23T18:49:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000f040 con 0x7fde94005180 2023-06-23T18:49:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.831+0000 7fdeaca19640 1 -- 172.21.15.81:0/4227704456 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00a5890 con 0x7fde94005180 2023-06-23T18:49:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 msgr2=0x7fde9400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 0x7fde9400b990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009fc0 tx=0x7fdea001cca0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/4227704456 shutdown_connections 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/4227704456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde94005180 0x7fde9400b990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/4227704456 >> 172.21.15.81:0/4227704456 conn(0x7fdea80c1fe0 msgr2=0x7fdea80c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/4227704456 shutdown_connections 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/4227704456 wait complete. 2023-06-23T18:49:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 Processor -- start 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- start start 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8134b00 0x7fdea81e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81340c0 con 0x7fdea8134b00 2023-06-23T18:49:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea812e960 con 0x7fdea81483c0 2023-06-23T18:49:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8142490 con 0x7fde94005180 2023-06-23T18:49:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeada1b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeada1b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:53064/0 (socket says 172.21.15.81:53064) 2023-06-23T18:49:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50776/0 (socket says 172.21.15.81:50776) 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 -- 172.21.15.81:0/3337176299 learned_addr learned my addr 172.21.15.81:0/3337176299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeae21c640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8134b00 0x7fdea81e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 -- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 msgr2=0x7fdea8141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 -- 172.21.15.81:0/3337176299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8134b00 msgr2=0x7fdea81e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8134b00 0x7fdea81e71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 -- 172.21.15.81:0/3337176299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8133ce0 con 0x7fdea81483c0 2023-06-23T18:49:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeada1b640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdead21a640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde9800f510 tx=0x7fde9800f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980052e0 con 0x7fdea81483c0 2023-06-23T18:49:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98005440 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea812ebb0 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98003800 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.835+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea8132850 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.839+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde98003c60 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.839+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fde9801dd70 con 0x7fdea81483c0 2023-06-23T18:49:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.839+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea8134200 con 0x7fdea81483c0 2023-06-23T18:49:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.839+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdea8134200 con 0x7fdea81483c0 2023-06-23T18:49:14.864 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:14.855+0000 7f4e3c069180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.907+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a50352f-25ca-4116-b04f-bbd2400a26b9", "id": 7} v 0) v1 -- 0x7fdea8133e70 con 0x7fdea81483c0 2023-06-23T18:49:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.915+0000 7fde9e7fc640 1 -- 172.21.15.81:0/3337176299 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a50352f-25ca-4116-b04f-bbd2400a26b9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde9801d530 con 0x7fdea81483c0 2023-06-23T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:7 2023-06-23T18:49:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 msgr2=0x7fdea8132310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde9800f510 tx=0x7fde9800f9d0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 shutdown_connections 2023-06-23T18:49:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8134b00 0x7fdea81e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea81483c0 0x7fdea8132310 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 --2- 172.21.15.81:0/3337176299 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde94005180 0x7fdea8141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 >> 172.21.15.81:0/3337176299 conn(0x7fdea80c1fe0 msgr2=0x7fdea806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 shutdown_connections 2023-06-23T18:49:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-23T18:49:14.919+0000 7fdeafc7f640 1 -- 172.21.15.81:0/3337176299 wait complete. 2023-06-23T18:49:14.943 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-23T18:49:14.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-23T18:49:14.947 INFO:tasks.ceph.osd.0:Started 2023-06-23T18:49:14.947 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-23T18:49:14.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-23T18:49:14.950 INFO:tasks.ceph.osd.1:Started 2023-06-23T18:49:14.950 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-23T18:49:14.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-23T18:49:14.953 INFO:tasks.ceph.osd.2:Started 2023-06-23T18:49:14.953 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-23T18:49:14.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-23T18:49:14.957 INFO:tasks.ceph.osd.3:Started 2023-06-23T18:49:14.957 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-23T18:49:14.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-23T18:49:14.961 INFO:tasks.ceph.osd.4:Started 2023-06-23T18:49:14.961 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-23T18:49:14.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-23T18:49:14.963 INFO:tasks.ceph.osd.5:Started 2023-06-23T18:49:14.964 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-23T18:49:14.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-23T18:49:14.966 INFO:tasks.ceph.osd.6:Started 2023-06-23T18:49:14.967 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-23T18:49:14.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-23T18:49:14.970 INFO:tasks.ceph.osd.7:Started 2023-06-23T18:49:14.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:15.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 Processor -- start 2023-06-23T18:49:15.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 -- start start 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0b40696d0 0x7ff0b4149250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40bc030 0x7ff0b4149790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff0b406edf0 0x7ff0b414a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4149cd0 con 0x7ff0b406edf0 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4149f80 con 0x7ff0b40696d0 2023-06-23T18:49:15.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0bab6d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b406a880 con 0x7ff0b40bc030 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff0b406edf0 0x7ff0b414a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff0b406edf0 0x7ff0b414a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49968/0 (socket says 172.21.15.38:49968) 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 -- 172.21.15.38:0/3049040072 learned_addr learned my addr 172.21.15.38:0/3049040072 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 -- 172.21.15.38:0/3049040072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40bc030 msgr2=0x7ff0b4149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 --2- 172.21.15.38:0/3049040072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40bc030 0x7ff0b4149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 -- 172.21.15.38:0/3049040072 >> v2:172.21.15.81:3300/0 conn(0x7ff0b40696d0 msgr2=0x7ff0b4149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:15.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 --2- 172.21.15.38:0/3049040072 >> v2:172.21.15.81:3300/0 conn(0x7ff0b40696d0 0x7ff0b4149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.124+0000 7ff0b910a640 1 -- 172.21.15.38:0/3049040072 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b414df40 con 0x7ff0b406edf0 2023-06-23T18:49:15.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0b910a640 1 --2- 172.21.15.38:0/3049040072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b406edf0 0x7ff0b414a410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff0b406d8c0 tx=0x7ff0ac01dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d597d574f021fe67 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0b37fe640 1 -- 172.21.15.38:0/3049040072 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0a6ac0 con 0x7ff0b406edf0 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0b37fe640 1 -- 172.21.15.38:0/3049040072 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0a6c20 con 0x7ff0b406edf0 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0b37fe640 1 -- 172.21.15.38:0/3049040072 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0ae3f0 con 0x7ff0b406edf0 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- 172.21.15.38:0/3049040072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b406edf0 msgr2=0x7ff0b414a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/3049040072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b406edf0 0x7ff0b414a410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff0b406d8c0 tx=0x7ff0ac01dd50 comp rx=0 tx=0).stop 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- 172.21.15.38:0/3049040072 shutdown_connections 2023-06-23T18:49:15.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/3049040072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b406edf0 0x7ff0b414a410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/3049040072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40bc030 0x7ff0b4149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/3049040072 >> v2:172.21.15.81:3300/0 conn(0x7ff0b40696d0 0x7ff0b4149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- 172.21.15.38:0/3049040072 >> 172.21.15.38:0/3049040072 conn(0x7ff0b40bc670 msgr2=0x7ff0b40bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- 172.21.15.38:0/3049040072 shutdown_connections 2023-06-23T18:49:15.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- 172.21.15.38:0/3049040072 wait complete. 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 Processor -- start 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.128+0000 7ff0bab6d640 1 -- start start 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40696d0 0x7ff0b4146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 0x7ff0b41e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:15.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b414d590 con 0x7ff0b40bc030 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b414c0a0 con 0x7ff0b406edf0 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4144250 con 0x7ff0b40696d0 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49978/0 (socket says 172.21.15.38:49978) 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 -- 172.21.15.38:0/1503002452 learned_addr learned my addr 172.21.15.38:0/1503002452 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b8909640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40696d0 0x7ff0b4146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:15.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b3fff640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 0x7ff0b41e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 -- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40696d0 msgr2=0x7ff0b4146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40696d0 0x7ff0b4146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 -- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 msgr2=0x7ff0b41e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 0x7ff0b41e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 -- 172.21.15.38:0/1503002452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac00c3d0 con 0x7ff0b40bc030 2023-06-23T18:49:15.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b910a640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac01c400 tx=0x7ff0ac01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b3fff640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 0x7ff0b41e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0aee80 con 0x7ff0b40bc030 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac009510 con 0x7ff0b40bc030 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b413e840 con 0x7ff0b40bc030 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0b7680 con 0x7ff0b40bc030 2023-06-23T18:49:15.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b414d200 con 0x7ff0b40bc030 2023-06-23T18:49:15.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0ac0b7ae0 con 0x7ff0b40bc030 2023-06-23T18:49:15.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff0ac0b7d90 con 0x7ff0b40bc030 2023-06-23T18:49:15.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.132+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b413ed60 con 0x7ff0b40bc030 2023-06-23T18:49:15.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.140+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff0b413ed60 con 0x7ff0b40bc030 2023-06-23T18:49:15.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0b404dfe0 con 0x7ff0b40bc030 2023-06-23T18:49:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0b17fa640 1 -- 172.21.15.38:0/1503002452 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff0ac0c1410 con 0x7ff0b40bc030 2023-06-23T18:49:15.213 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:15.213 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:14.917601+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 msgr2=0x7ff0b41e79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac01c400 tx=0x7ff0ac01aaf0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 shutdown_connections 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0b40bc030 0x7ff0b41e79a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0b406edf0 0x7ff0b41e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 --2- 172.21.15.38:0/1503002452 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff0b40696d0 0x7ff0b4146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 >> 172.21.15.38:0/1503002452 conn(0x7ff0b40bc670 msgr2=0x7ff0b406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 shutdown_connections 2023-06-23T18:49:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:15.208+0000 7ff0bab6d640 1 -- 172.21.15.38:0/1503002452 wait complete. 2023-06-23T18:49:15.229 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-23T18:49:15.229 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-23T18:49:15.370 INFO:tasks.ceph.mgr.y.smithi038.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-23T18:49:15.370 INFO:tasks.ceph.mgr.y.smithi038.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-23T18:49:15.371 INFO:tasks.ceph.mgr.y.smithi038.stderr: from numpy import show_config as show_numpy_config 2023-06-23T18:49:15.437 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:15.432+0000 7fe65ced6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T18:49:15.480 INFO:tasks.ceph.mgr.x.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-23T18:49:15.480 INFO:tasks.ceph.mgr.x.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-23T18:49:15.480 INFO:tasks.ceph.mgr.x.smithi081.stderr: from numpy import show_config as show_numpy_config 2023-06-23T18:49:15.529 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:15.518+0000 7f4e3c069180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T18:49:15.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-06-23T18:49:15.564+0000 7f31cf57c640 -1 Falling back to public interface 2023-06-23T18:49:15.580 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-06-23T18:49:15.576+0000 7f5eead38640 -1 Falling back to public interface 2023-06-23T18:49:15.581 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-23T18:49:15.570+0000 7f6bcbb22640 -1 Falling back to public interface 2023-06-23T18:49:15.587 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-06-23T18:49:15.584+0000 7f0062d3e640 -1 Falling back to public interface 2023-06-23T18:49:15.588 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-06-23T18:49:15.584+0000 7fd70b6ef640 -1 Falling back to public interface 2023-06-23T18:49:15.599 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-23T18:49:15.590+0000 7f8596d04640 -1 Falling back to public interface 2023-06-23T18:49:15.609 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:15.604+0000 7fe65ced6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:49:15.624 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-23T18:49:15.614+0000 7f758751d640 -1 Falling back to public interface 2023-06-23T18:49:15.627 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-23T18:49:15.618+0000 7f78d498a640 -1 Falling back to public interface 2023-06-23T18:49:15.661 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:15.650+0000 7f4e3c069180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:49:15.763 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:15.756+0000 7fe65ced6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T18:49:15.823 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:15.814+0000 7f4e3c069180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T18:49:15.844 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:15.840+0000 7fe65ced6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T18:49:15.886 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:15.874+0000 7f4e3c069180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T18:49:15.975 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:15.972+0000 7fe65ced6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:49:16.008 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:15.998+0000 7f4e3c069180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:49:16.033 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:16.149 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 Processor -- start 2023-06-23T18:49:16.149 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 -- start start 2023-06-23T18:49:16.149 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f128c06cb60 0x7f128c069470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:16.149 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f128c0be4b0 0x7f128c0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:16.150 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c14f110 con 0x7f128c0befd0 2023-06-23T18:49:16.150 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c06c320 con 0x7f128c06cb60 2023-06-23T18:49:16.150 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f1291e29640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0699b0 con 0x7f128c0be4b0 2023-06-23T18:49:16.150 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f128c06cb60 0x7f128c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:16.150 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f128c06cb60 0x7f128c069470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36072/0 (socket says 172.21.15.38:36072) 2023-06-23T18:49:16.151 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 -- 172.21.15.38:0/1065159981 learned_addr learned my addr 172.21.15.38:0/1065159981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:16.151 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128bfff640 1 --2- 172.21.15.38:0/1065159981 >> v2:172.21.15.81:3300/0 conn(0x7f128c0be4b0 0x7f128c0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:16.156 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 -- 172.21.15.38:0/1065159981 >> v2:172.21.15.81:3300/0 conn(0x7f128c0be4b0 msgr2=0x7f128c0be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:16.157 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 --2- 172.21.15.38:0/1065159981 >> v2:172.21.15.81:3300/0 conn(0x7f128c0be4b0 0x7f128c0be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.157 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 -- 172.21.15.38:0/1065159981 >> v1:172.21.15.81:6789/0 conn(0x7f128c0befd0 legacy=0x7f128c14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:16.157 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.144+0000 7f128b7fe640 1 -- 172.21.15.38:0/1065159981 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c06bb80 con 0x7f128c06cb60 2023-06-23T18:49:16.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128b7fe640 1 --2- 172.21.15.38:0/1065159981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c06cb60 0x7f128c069470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f128c06e380 tx=0x7f127c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b863c1445b3c7a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:16.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128a7fc640 1 -- 172.21.15.38:0/1065159981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0ab600 con 0x7f128c06cb60 2023-06-23T18:49:16.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128a7fc640 1 -- 172.21.15.38:0/1065159981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c0a7050 con 0x7f128c06cb60 2023-06-23T18:49:16.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128a7fc640 1 -- 172.21.15.38:0/1065159981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0ab980 con 0x7f128c06cb60 2023-06-23T18:49:16.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/1065159981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c06cb60 msgr2=0x7f128c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:16.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- 172.21.15.38:0/1065159981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c06cb60 0x7f128c069470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f128c06e380 tx=0x7f127c01c430 comp rx=0 tx=0).stop 2023-06-23T18:49:16.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/1065159981 shutdown_connections 2023-06-23T18:49:16.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- 172.21.15.38:0/1065159981 >> v2:172.21.15.81:3300/0 conn(0x7f128c0be4b0 0x7f128c0be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- 172.21.15.38:0/1065159981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c06cb60 0x7f128c069470 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/1065159981 >> 172.21.15.38:0/1065159981 conn(0x7f128c0c05b0 msgr2=0x7f128c0c09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:16.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/1065159981 shutdown_connections 2023-06-23T18:49:16.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/1065159981 wait complete. 2023-06-23T18:49:16.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 Processor -- start 2023-06-23T18:49:16.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- start start 2023-06-23T18:49:16.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c06cb60 0x7f128c06e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:16.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f128c0be4b0 0x7f128c1e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:16.163 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:16.163 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c1e9520 con 0x7f128c0befd0 2023-06-23T18:49:16.163 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c142520 con 0x7f128c06cb60 2023-06-23T18:49:16.164 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c09f810 con 0x7f128c0be4b0 2023-06-23T18:49:16.164 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:16.164 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36076/0 (socket says 172.21.15.38:36076) 2023-06-23T18:49:16.164 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 -- 172.21.15.38:0/3317535880 learned_addr learned my addr 172.21.15.38:0/3317535880 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:16.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128affd640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f128c0be4b0 0x7f128c1e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:16.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128b7fe640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c06cb60 0x7f128c06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:16.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 -- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f128c0be4b0 msgr2=0x7f128c1e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:16.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f128c0be4b0 0x7f128c1e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 -- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c06cb60 msgr2=0x7f128c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:16.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c06cb60 0x7f128c06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 -- 172.21.15.38:0/3317535880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0094d0 con 0x7f128c0befd0 2023-06-23T18:49:16.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f128bfff640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1284007e40 tx=0x7f128400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:16.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284014620 con 0x7f128c0befd0 2023-06-23T18:49:16.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128400ee90 con 0x7f128c0befd0 2023-06-23T18:49:16.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c06ed50 con 0x7f128c0befd0 2023-06-23T18:49:16.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840149e0 con 0x7f128c0befd0 2023-06-23T18:49:16.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c09f1c0 con 0x7f128c0befd0 2023-06-23T18:49:16.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f128401e460 con 0x7f128c0befd0 2023-06-23T18:49:16.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.148+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f128401da90 con 0x7f128c0befd0 2023-06-23T18:49:16.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.152+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c04d790 con 0x7f128c0befd0 2023-06-23T18:49:16.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.152+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f128401de20 con 0x7f128c0befd0 2023-06-23T18:49:16.214 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.208+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128c09f950 con 0x7f128c0befd0 2023-06-23T18:49:16.216 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1273fff640 1 -- 172.21.15.38:0/3317535880 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f128401d4d0 con 0x7f128c0befd0 2023-06-23T18:49:16.216 INFO:teuthology.misc.health.smithi038.stdout: 2023-06-23T18:49:16.217 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:14.917601+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:16.218 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 msgr2=0x7f128c1ea0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:16.218 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1284007e40 tx=0x7f128400e4b0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.218 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 shutdown_connections 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128c0befd0 0x7f128c1ea0e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f128c0be4b0 0x7f128c1e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 --2- 172.21.15.38:0/3317535880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f128c06cb60 0x7f128c06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 >> 172.21.15.38:0/3317535880 conn(0x7f128c0c05b0 msgr2=0x7f128c145cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 shutdown_connections 2023-06-23T18:49:16.219 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:16.212+0000 7f1291e29640 1 -- 172.21.15.38:0/3317535880 wait complete. 2023-06-23T18:49:16.230 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-23T18:49:16.599 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:16.590+0000 7f4e3c069180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T18:49:16.610 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:16.604+0000 7fe65ced6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T18:49:16.676 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:16.666+0000 7f4e3c069180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T18:49:16.689 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:16.684+0000 7fe65ced6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T18:49:16.843 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:16.834+0000 7f4e3c069180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T18:49:16.864 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:16.860+0000 7fe65ced6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T18:49:16.916 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:16.906+0000 7f4e3c069180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T18:49:16.941 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:16.936+0000 7fe65ced6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T18:49:17.157 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:17.146+0000 7f4e3c069180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T18:49:17.197 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:17.192+0000 7fe65ced6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T18:49:17.216 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:17.206+0000 7f4e3c069180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T18:49:17.260 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-06-23T18:49:17.256+0000 7fe65ced6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T18:49:18.264 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:18.254+0000 7f4de3a29640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-23T18:49:18.266 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-23T18:49:18.254+0000 7f4de3a29640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-23T18:49:18.837 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-23T18:49:18.826+0000 7f8596d04640 -1 osd.5 0 log_to_monitors true 2023-06-23T18:49:19.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-06-23T18:49:19.424+0000 7f31cf57c640 -1 osd.1 0 log_to_monitors true 2023-06-23T18:49:19.503 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-23T18:49:19.490+0000 7f6bcbb22640 -1 osd.4 0 log_to_monitors true 2023-06-23T18:49:19.538 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-06-23T18:49:19.532+0000 7f0062d3e640 -1 osd.3 0 log_to_monitors true 2023-06-23T18:49:19.538 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-06-23T18:49:19.532+0000 7f5eead38640 -1 osd.2 0 log_to_monitors true 2023-06-23T18:49:19.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-06-23T18:49:19.536+0000 7fd70b6ef640 -1 osd.0 0 log_to_monitors true 2023-06-23T18:49:19.571 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-23T18:49:19.562+0000 7f78d498a640 -1 osd.7 0 log_to_monitors true 2023-06-23T18:49:19.628 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-23T18:49:19.618+0000 7f758751d640 -1 osd.6 0 log_to_monitors true 2023-06-23T18:49:20.947 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-23T18:49:20.938+0000 7f8592ca9640 -1 osd.5 0 waiting for initial osdmap 2023-06-23T18:49:20.967 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-23T18:49:20.958+0000 7f858aadc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.233 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-23T18:49:22.222+0000 7f75834c2640 -1 osd.6 0 waiting for initial osdmap 2023-06-23T18:49:22.266 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-23T18:49:22.254+0000 7f78d092f640 -1 osd.7 0 waiting for initial osdmap 2023-06-23T18:49:22.271 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-23T18:49:22.262+0000 7f757b2f5640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.287 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-23T18:49:22.278+0000 7f78c8762640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.297 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-23T18:49:22.286+0000 7f6bc7ac7640 -1 osd.4 0 waiting for initial osdmap 2023-06-23T18:49:22.316 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-23T18:49:22.306+0000 7f6bbf8fa640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.458 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-06-23T18:49:22.452+0000 7f005ece3640 -1 osd.3 0 waiting for initial osdmap 2023-06-23T18:49:22.489 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-06-23T18:49:22.484+0000 7fd707694640 -1 osd.0 0 waiting for initial osdmap 2023-06-23T18:49:22.491 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-06-23T18:49:22.488+0000 7f0056b16640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.511 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-06-23T18:49:22.508+0000 7f5ee6cdd640 -1 osd.2 0 waiting for initial osdmap 2023-06-23T18:49:22.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-06-23T18:49:22.524+0000 7f31cb521640 -1 osd.1 0 waiting for initial osdmap 2023-06-23T18:49:22.535 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-06-23T18:49:22.532+0000 7f5edeb10640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-06-23T18:49:22.536+0000 7fd6ff4c7640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-06-23T18:49:22.552+0000 7f31c3354640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:49:22.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:22.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:22.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:22.949 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:22.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:23.034 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:23.156 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 Processor -- start 2023-06-23T18:49:23.156 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 -- start start 2023-06-23T18:49:23.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9aa80c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.158 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa806ab10 con 0x7f9aa80c11e0 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa808a230 con 0x7f9aa80a32c0 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aad771640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c2b20 con 0x7f9aa80beb60 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa67fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9aa80c11e0 0x7f9aa8069cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43180/0 (socket says 172.21.15.38:43180) 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa67fc640 1 -- 172.21.15.38:0/902855326 learned_addr learned my addr 172.21.15.38:0/902855326 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9aa80c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107862786 0 0) 0x7f9aa806ab10 con 0x7f9aa80c11e0 2023-06-23T18:49:23.159 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a90003530 con 0x7f9aa80c11e0 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855079909 0 0) 0x7f9a90003530 con 0x7f9aa80c11e0 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 msgr2=0x7f9aa80c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9aa80c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 >> v1:172.21.15.81:6789/0 conn(0x7f9aa80a32c0 legacy=0x7f9aa806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80c2840 con 0x7f9aa80c11e0 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f9a9c001680 con 0x7f9aa80c11e0 2023-06-23T18:49:23.160 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 >> v1:172.21.15.38:6789/0 conn(0x7f9aa80c11e0 legacy=0x7f9aa8069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a900039b0 0x7f9a90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9a900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90004d10 0x7f9a90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c2b20 con 0x7f9a900039b0 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9000baa0 con 0x7f9a90004d10 2023-06-23T18:49:23.161 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9000bc60 con 0x7f9aa80beb60 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a900039b0 0x7f9a90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa67fc640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9a900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa77fe640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90004d10 0x7f9a90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 -- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 msgr2=0x7f9a900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa80beb60 0x7f9a900047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 -- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90004d10 msgr2=0x7f9a90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:23.162 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90004d10 0x7f9a90005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.163 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.152+0000 7f9aa6ffd640 1 -- 172.21.15.38:0/902855326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90003530 con 0x7f9a900039b0 2023-06-23T18:49:23.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a900039b0 0x7f9a90003dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009ae0 tx=0x7f9a9801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3b93bbdbd34c86 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:23.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980a6430 con 0x7f9a900039b0 2023-06-23T18:49:23.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a980a6590 con 0x7f9a900039b0 2023-06-23T18:49:23.165 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa5ffb640 1 -- 172.21.15.38:0/902855326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980a6940 con 0x7f9a900039b0 2023-06-23T18:49:23.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- 172.21.15.38:0/902855326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a900039b0 msgr2=0x7f9a90003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 --2- 172.21.15.38:0/902855326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a900039b0 0x7f9a90003dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009ae0 tx=0x7f9a9801ca50 comp rx=0 tx=0).stop 2023-06-23T18:49:23.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa77fe640 1 -- 172.21.15.38:0/902855326 reap_dead start 2023-06-23T18:49:23.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- 172.21.15.38:0/902855326 shutdown_connections 2023-06-23T18:49:23.166 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- 172.21.15.38:0/902855326 >> 172.21.15.38:0/902855326 conn(0x7f9aa80c42b0 msgr2=0x7f9aa80c46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- 172.21.15.38:0/902855326 shutdown_connections 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- 172.21.15.38:0/902855326 wait complete. 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 Processor -- start 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- start start 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900039b0 0x7f9aa80a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa814e8c0 0x7f9aa814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.167 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80bc170 con 0x7f9aa80bddb0 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80bb9b0 con 0x7f9a900039b0 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aad771640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81eac70 con 0x7f9aa814e8c0 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36116/0 (socket says 172.21.15.38:36116) 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.156+0000 7f9aa77fe640 1 -- 172.21.15.38:0/4217872271 learned_addr learned my addr 172.21.15.38:0/4217872271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:23.168 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 -- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa814e8c0 msgr2=0x7f9aa814da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa814e8c0 0x7f9aa814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 -- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900039b0 msgr2=0x7f9aa80a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900039b0 0x7f9aa80a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900039b0 0x7f9aa80a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 -- 172.21.15.38:0/4217872271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80bbc50 con 0x7f9aa80bddb0 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa77fe640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9aa808a040 tx=0x7f9aa000d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:23.169 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000b070 con 0x7f9aa80bddb0 2023-06-23T18:49:23.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa80a8970 con 0x7f9aa80bddb0 2023-06-23T18:49:23.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0003980 con 0x7f9aa80bddb0 2023-06-23T18:49:23.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0003d30 con 0x7f9aa80bddb0 2023-06-23T18:49:23.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa814e510 con 0x7f9aa80bddb0 2023-06-23T18:49:23.170 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa81eaa80 con 0x7f9aa80bddb0 2023-06-23T18:49:23.171 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f9aa0005070 con 0x7f9aa80bddb0 2023-06-23T18:49:23.171 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 0x7f9a940686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:23.171 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f9aa00821d0 con 0x7f9aa80bddb0 2023-06-23T18:49:23.171 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 0x7f9a940686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:23.172 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.160+0000 7f9aa6ffd640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 0x7f9a940686a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a980046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:23.172 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.164+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9aa0050370 con 0x7f9aa80bddb0 2023-06-23T18:49:23.320 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.316+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa80bbe40 con 0x7f9aa80bddb0 2023-06-23T18:49:23.326 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.320+0000 7f9a8f7fe640 1 -- 172.21.15.38:0/4217872271 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8051 (secure 0 0 0) 0x7f9aa0018090 con 0x7f9aa80bddb0 2023-06-23T18:49:23.326 INFO:teuthology.misc.health.smithi038.stdout: 2023-06-23T18:49:23.326 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":14,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:22.302697+0000","last_up_change":"2023-06-23T18:49:22.302697+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:23.328 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 msgr2=0x7f9a940686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.328 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 0x7f9a940686a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a980046d0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 msgr2=0x7f9aa814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9aa808a040 tx=0x7f9aa000d830 comp rx=0 tx=0).stop 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 shutdown_connections 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9a940661f0 0x7f9a940686a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9aa80bddb0 0x7f9aa814dfd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9aa814e8c0 0x7f9aa814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.329 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 --2- 172.21.15.38:0/4217872271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900039b0 0x7f9aa80a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:23.330 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 >> 172.21.15.38:0/4217872271 conn(0x7f9aa80c42b0 msgr2=0x7f9aa80a6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:23.330 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 shutdown_connections 2023-06-23T18:49:23.330 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:23.324+0000 7f9aad771640 1 -- 172.21.15.38:0/4217872271 wait complete. 2023-06-23T18:49:23.351 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-06-23T18:49:30.157 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:30.280 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 Processor -- start 2023-06-23T18:49:30.280 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 -- start start 2023-06-23T18:49:30.281 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f405414e070 0x7f40540bb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.281 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405414e4b0 con 0x7f40540bc810 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40540bac30 con 0x7f40540b9220 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405c266640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405414f0c0 con 0x7f405414e070 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a002640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f40540bc810 0x7f40540bcbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55850/0 (socket says 172.21.15.38:55850) 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a002640 1 -- 172.21.15.38:0/2432671435 learned_addr learned my addr 172.21.15.38:0/2432671435 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 --2- 172.21.15.38:0/2432671435 >> v2:172.21.15.81:3300/0 conn(0x7f405414e070 0x7f40540bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232840277 0 0) 0x7f405414e4b0 con 0x7f40540bc810 2023-06-23T18:49:30.282 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4040003530 con 0x7f40540bc810 2023-06-23T18:49:30.284 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584052666 0 0) 0x7f4040003530 con 0x7f40540bc810 2023-06-23T18:49:30.284 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 >> v2:172.21.15.81:3300/0 conn(0x7f405414e070 msgr2=0x7f40540bb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:30.284 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 --2- 172.21.15.38:0/2432671435 >> v2:172.21.15.81:3300/0 conn(0x7f405414e070 0x7f40540bb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.284 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 >> v1:172.21.15.81:6789/0 conn(0x7f40540b9220 legacy=0x7f405414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.284 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540baf10 con 0x7f40540bc810 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f4050001680 con 0x7f40540bc810 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 >> v1:172.21.15.38:6789/0 conn(0x7f40540bc810 legacy=0x7f40540bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4040003980 0x7f4040003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f4040004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4040005180 0x7f404000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.285 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404000bfd0 con 0x7f40400047d0 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404000c140 con 0x7f4040005180 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404000c300 con 0x7f4040003980 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f4040004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a002640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4040003980 0x7f4040003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a803640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4040005180 0x7f404000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 -- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4040003980 msgr2=0x7f4040003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:30.286 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4040003980 0x7f4040003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.287 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 -- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4040005180 msgr2=0x7f404000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:30.287 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4040005180 0x7f404000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.287 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f4059801640 1 -- 172.21.15.38:0/2432671435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040003530 con 0x7f40400047d0 2023-06-23T18:49:30.287 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a803640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4040005180 0x7f404000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:30.287 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.276+0000 7f405a803640 1 -- 172.21.15.38:0/2432671435 reap_dead start 2023-06-23T18:49:30.289 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f4059801640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f4040004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f404801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee8f72405d13a8a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.289 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480a5560 con 0x7f40400047d0 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40480a56c0 con 0x7f40400047d0 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f4059000640 1 -- 172.21.15.38:0/2432671435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480a5a70 con 0x7f40400047d0 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 msgr2=0x7f4040004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f4040004c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f404801ca50 comp rx=0 tx=0).stop 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- 172.21.15.38:0/2432671435 shutdown_connections 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 --2- 172.21.15.38:0/2432671435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f4040004c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.290 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- 172.21.15.38:0/2432671435 >> 172.21.15.38:0/2432671435 conn(0x7f40540bfe20 msgr2=0x7f40540c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- 172.21.15.38:0/2432671435 shutdown_connections 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- 172.21.15.38:0/2432671435 wait complete. 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 Processor -- start 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- start start 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414cc50 0x7f40540b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.291 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405414ae40 0x7f40540b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40541e7fc0 con 0x7f40400047d0 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540b4eb0 con 0x7f405414cc50 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405c266640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540b5190 con 0x7f405414ae40 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405a002640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405a002640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42514/0 (socket says 172.21.15.38:42514) 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405a002640 1 -- 172.21.15.38:0/747632855 learned_addr learned my addr 172.21.15.38:0/747632855 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:30.292 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f4059801640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414cc50 0x7f40540b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.280+0000 7f405a803640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405414ae40 0x7f40540b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 -- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405414ae40 msgr2=0x7f40540b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405414ae40 0x7f40540b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 -- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414cc50 msgr2=0x7f40540b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414cc50 0x7f40540b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 -- 172.21.15.38:0/747632855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540b5470 con 0x7f40400047d0 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405a002640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4050000f70 tx=0x7f405000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.293 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050010ea0 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40500143a0 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40540c04d0 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050014710 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405414d0c0 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40540b56b0 con 0x7f40400047d0 2023-06-23T18:49:30.294 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4050014870 con 0x7f40400047d0 2023-06-23T18:49:30.295 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 0x7f4038068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.295 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4050086a10 con 0x7f40400047d0 2023-06-23T18:49:30.295 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f4059801640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 0x7f4038068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.295 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.284+0000 7f4059801640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 0x7f4038068760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f40480af000 tx=0x7f4048008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.296 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.288+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40540b56b0 con 0x7f40400047d0 2023-06-23T18:49:30.450 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.444+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40540b5660 con 0x7f40400047d0 2023-06-23T18:49:30.451 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.444+0000 7f40467fc640 1 -- 172.21.15.38:0/747632855 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f405001b020 con 0x7f40400047d0 2023-06-23T18:49:30.452 INFO:teuthology.misc.health.smithi038.stdout: 2023-06-23T18:49:30.452 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":17,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:25.346858+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:30.454 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 msgr2=0x7f4038068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.454 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 0x7f4038068760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f40480af000 tx=0x7f4048008040 comp rx=0 tx=0).stop 2023-06-23T18:49:30.454 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 msgr2=0x7f40541e7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.455 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4050000f70 tx=0x7f405000e4d0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.455 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 shutdown_connections 2023-06-23T18:49:30.455 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f40380662b0 0x7f4038068760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.455 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405414ae40 0x7f40540b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.456 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405414cc50 0x7f40540b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.456 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 --2- 172.21.15.38:0/747632855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40400047d0 0x7f40541e7080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.456 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 >> 172.21.15.38:0/747632855 conn(0x7f40540bfe20 msgr2=0x7f405406efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:30.456 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 shutdown_connections 2023-06-23T18:49:30.459 INFO:teuthology.misc.health.smithi038.stderr:2023-06-23T18:49:30.448+0000 7f405c266640 1 -- 172.21.15.38:0/747632855 wait complete. 2023-06-23T18:49:30.468 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-23T18:49:30.468 INFO:tasks.ceph:Creating RBD pool 2023-06-23T18:49:30.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-23T18:49:30.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 Processor -- start 2023-06-23T18:49:30.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 -- start start 2023-06-23T18:49:30.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb580ba7f0 0x7fbb580c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb58070270 con 0x7fbb58149980 2023-06-23T18:49:30.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5814ff20 con 0x7fbb5806c4b0 2023-06-23T18:49:30.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5f69c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb581504e0 con 0x7fbb580ba7f0 2023-06-23T18:49:30.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb580ba7f0 0x7fbb580c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb580ba7f0 0x7fbb580c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42516/0 (socket says 172.21.15.38:42516) 2023-06-23T18:49:30.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 -- 172.21.15.38:0/340560935 learned_addr learned my addr 172.21.15.38:0/340560935 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 -- 172.21.15.38:0/340560935 >> v1:172.21.15.81:6789/0 conn(0x7fbb5806c4b0 legacy=0x7fbb58149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 -- 172.21.15.38:0/340560935 >> v1:172.21.15.38:6789/0 conn(0x7fbb58149980 legacy=0x7fbb58070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.587+0000 7fbb5dc39640 1 -- 172.21.15.38:0/340560935 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58150200 con 0x7fbb580ba7f0 2023-06-23T18:49:30.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5dc39640 1 --2- 172.21.15.38:0/340560935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb580ba7f0 0x7fbb580c09d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009870 tx=0x7fbb5401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3dedd01a9c44a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb4ffff640 1 -- 172.21.15.38:0/340560935 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540ab650 con 0x7fbb580ba7f0 2023-06-23T18:49:30.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb4ffff640 1 -- 172.21.15.38:0/340560935 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540ab7b0 con 0x7fbb580ba7f0 2023-06-23T18:49:30.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb4ffff640 1 -- 172.21.15.38:0/340560935 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540abb40 con 0x7fbb580ba7f0 2023-06-23T18:49:30.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- 172.21.15.38:0/340560935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb580ba7f0 msgr2=0x7fbb580c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/340560935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb580ba7f0 0x7fbb580c09d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009870 tx=0x7fbb5401c540 comp rx=0 tx=0).stop 2023-06-23T18:49:30.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- 172.21.15.38:0/340560935 shutdown_connections 2023-06-23T18:49:30.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/340560935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb580ba7f0 0x7fbb580c09d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- 172.21.15.38:0/340560935 >> 172.21.15.38:0/340560935 conn(0x7fbb580bfe30 msgr2=0x7fbb580c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:30.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- 172.21.15.38:0/340560935 shutdown_connections 2023-06-23T18:49:30.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- 172.21.15.38:0/340560935 wait complete. 2023-06-23T18:49:30.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 Processor -- start 2023-06-23T18:49:30.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.591+0000 7fbb5f69c640 1 -- start start 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb580ba7f0 0x7fbb581466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58149980 0x7fbb5806e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5806fea0 con 0x7fbb5806c4b0 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5814f080 con 0x7fbb58149980 2023-06-23T18:49:30.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58146c30 con 0x7fbb580ba7f0 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42526/0 (socket says 172.21.15.38:42526) 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 -- 172.21.15.38:0/2582249999 learned_addr learned my addr 172.21.15.38:0/2582249999 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5dc39640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58149980 0x7fbb5806e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5cc37640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb580ba7f0 0x7fbb581466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 -- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb580ba7f0 msgr2=0x7fbb581466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb580ba7f0 0x7fbb581466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 -- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58149980 msgr2=0x7fbb5806e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:30.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58149980 0x7fbb5806e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:30.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 -- 172.21.15.38:0/2582249999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540094d0 con 0x7fbb5806c4b0 2023-06-23T18:49:30.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5d438640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7f0 tx=0x7fbb5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50003b80 con 0x7fbb5806c4b0 2023-06-23T18:49:30.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50003ce0 con 0x7fbb5806c4b0 2023-06-23T18:49:30.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5814e240 con 0x7fbb5806c4b0 2023-06-23T18:49:30.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000aa90 con 0x7fbb5806c4b0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb580ba110 con 0x7fbb5806c4b0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5804d790 con 0x7fbb5806c4b0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb5000abf0 con 0x7fbb5806c4b0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 0x7fbb3c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.595+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb50083760 con 0x7fbb5806c4b0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.599+0000 7fbb5cc37640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 0x7fbb3c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:30.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.599+0000 7fbb5cc37640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 0x7fbb3c068760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb58148df0 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:30.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.599+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb50051080 con 0x7fbb5806c4b0 2023-06-23T18:49:30.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:30.759+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbb58149760 con 0x7fbb5806c4b0 2023-06-23T18:49:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.307+0000 7fbb4dffb640 1 -- 172.21.15.38:0/2582249999 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbb500546a0 con 0x7fbb5806c4b0 2023-06-23T18:49:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 msgr2=0x7fbb3c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 0x7fbb3c068760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb58148df0 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 msgr2=0x7fbb5814eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c7f0 tx=0x7fbb5000ccb0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 shutdown_connections 2023-06-23T18:49:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb3c0662b0 0x7fbb3c068760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58149980 0x7fbb5806e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb580ba7f0 0x7fbb581466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 --2- 172.21.15.38:0/2582249999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb5806c4b0 0x7fbb5814eb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 >> 172.21.15.38:0/2582249999 conn(0x7fbb580bfe30 msgr2=0x7fbb580bf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 shutdown_connections 2023-06-23T18:49:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.311+0000 7fbb5f69c640 1 -- 172.21.15.38:0/2582249999 wait complete. 2023-06-23T18:49:31.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-23T18:49:31.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 Processor -- start 2023-06-23T18:49:31.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 -- start start 2023-06-23T18:49:31.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d900bd1e0 0x7f3d9014c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900ba9d0 con 0x7f3d9014b930 2023-06-23T18:49:31.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d90150160 con 0x7f3d9006a630 2023-06-23T18:49:31.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.459+0000 7f3d95235640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900bc300 con 0x7f3d900bd1e0 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3d9014b930 0x7f3d9006c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55868/0 (socket says 172.21.15.38:55868) 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8ed9d640 1 -- 172.21.15.38:0/4207857004 learned_addr learned my addr 172.21.15.38:0/4207857004 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/4207857004 >> v2:172.21.15.81:3300/0 conn(0x7f3d900bd1e0 0x7f3d9014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447349674 0 0) 0x7f3d900ba9d0 con 0x7f3d9014b930 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d7c003530 con 0x7f3d9014b930 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687024087 0 0) 0x7f3d7c003530 con 0x7f3d9014b930 2023-06-23T18:49:31.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 >> v2:172.21.15.81:3300/0 conn(0x7f3d900bd1e0 msgr2=0x7f3d9014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 --2- 172.21.15.38:0/4207857004 >> v2:172.21.15.81:3300/0 conn(0x7f3d900bd1e0 0x7f3d9014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 >> v1:172.21.15.81:6789/0 conn(0x7f3d9006a630 legacy=0x7f3d9014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90150440 con 0x7f3d9014b930 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f3d88001a00 con 0x7f3d9014b930 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 >> v1:172.21.15.38:6789/0 conn(0x7f3d9014b930 legacy=0x7f3d9006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7c003980 0x7f3d7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d7c005180 0x7f3d7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900bc300 con 0x7f3d7c0047d0 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c00c000 con 0x7f3d7c003980 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c00c1c0 con 0x7f3d7c005180 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8ed9d640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7c003980 0x7f3d7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8f59e640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d7c005180 0x7f3d7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 -- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d7c005180 msgr2=0x7f3d7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d7c005180 0x7f3d7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 -- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7c003980 msgr2=0x7f3d7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7c003980 0x7f3d7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 -- 172.21.15.38:0/4207857004 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c003530 con 0x7f3d7c0047d0 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8f59e640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d7c005180 0x7f3d7c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:31.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8f59e640 1 -- 172.21.15.38:0/4207857004 reap_dead start 2023-06-23T18:49:31.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d7c004c40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009ae0 tx=0x7f3d7801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5c7cf25aaf060d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a6460 con 0x7f3d7c0047d0 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780a65c0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.463+0000 7f3d8dd9b640 1 -- 172.21.15.38:0/4207857004 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a6970 con 0x7f3d7c0047d0 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 msgr2=0x7f3d7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d7c004c40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009ae0 tx=0x7f3d7801ca50 comp rx=0 tx=0).stop 2023-06-23T18:49:31.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/4207857004 shutdown_connections 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 --2- 172.21.15.38:0/4207857004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d7c004c40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/4207857004 >> 172.21.15.38:0/4207857004 conn(0x7f3d900c0c90 msgr2=0x7f3d900bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/4207857004 shutdown_connections 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/4207857004 wait complete. 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 Processor -- start 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- start start 2023-06-23T18:49:31.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 0x7f3d901470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d901475f0 0x7f3d901e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900a5570 con 0x7f3d7c0047d0 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900b8190 con 0x7f3d901475f0 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900b7db0 con 0x7f3d900b6b80 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42548/0 (socket says 172.21.15.38:42548) 2023-06-23T18:49:31.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 -- 172.21.15.38:0/3703153635 learned_addr learned my addr 172.21.15.38:0/3703153635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8f59e640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d901475f0 0x7f3d901e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 0x7f3d901470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 -- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 msgr2=0x7f3d901470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 0x7f3d901470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 -- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d901475f0 msgr2=0x7f3d901e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d901475f0 0x7f3d901e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 -- 172.21.15.38:0/3703153635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900b6fd0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 0x7f3d901470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d8ed9d640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d88011980 tx=0x7f3d88011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800fc20 con 0x7f3d7c0047d0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800fd80 con 0x7f3d7c0047d0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d900a4a40 con 0x7f3d7c0047d0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88015650 con 0x7f3d7c0047d0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9006fea0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.467+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d900b82d0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.471+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d880157b0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.471+0000 7f3d877fe640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 0x7f3d70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:31.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.471+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f3d88086cd0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.471+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 0x7f3d70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:31.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.471+0000 7f3d8e59c640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 0x7f3d70068760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d780ad000 tx=0x7f3d780a9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:31.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.475+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d900b82d0 con 0x7f3d7c0047d0 2023-06-23T18:49:31.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:31.627+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3d900b82d0 con 0x7f3d7c0047d0 2023-06-23T18:49:32.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.311+0000 7f3d877fe640 1 -- 172.21.15.38:0/3703153635 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3d900b82d0 con 0x7f3d7c0047d0 2023-06-23T18:49:32.319 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-23T18:49:32.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.315+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 msgr2=0x7f3d70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.315+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 0x7f3d70068760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d780ad000 tx=0x7f3d780a9040 comp rx=0 tx=0).stop 2023-06-23T18:49:32.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 msgr2=0x7f3d900b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d88011980 tx=0x7f3d88011e40 comp rx=0 tx=0).stop 2023-06-23T18:49:32.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 shutdown_connections 2023-06-23T18:49:32.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3d700662b0 0x7f3d70068760 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d780ad000 tx=0x7f3d780a9040 comp rx=0 tx=0).stop 2023-06-23T18:49:32.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d901475f0 0x7f3d901e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d900b6b80 0x7f3d901470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 --2- 172.21.15.38:0/3703153635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d7c0047d0 0x7f3d900b6640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 >> 172.21.15.38:0/3703153635 conn(0x7f3d900c0c90 msgr2=0x7f3d90148680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:32.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 shutdown_connections 2023-06-23T18:49:32.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.319+0000 7f3d95235640 1 -- 172.21.15.38:0/3703153635 wait complete. 2023-06-23T18:49:32.350 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-23T18:49:32.351 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T18:49:32.351 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T18:49:32.353 INFO:tasks.ceph.mds.a:Started 2023-06-23T18:49:32.354 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T18:49:32.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T18:49:32.357 INFO:tasks.ceph.mds.b:Started 2023-06-23T18:49:32.358 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-23T18:49:32.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:32.438 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-06-23T18:49:32.448 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-06-23T18:49:32.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.483+0000 7f86eb0ff640 1 Processor -- start 2023-06-23T18:49:32.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.483+0000 7f86eb0ff640 1 -- start start 2023-06-23T18:49:32.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86eb0ff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86eb0ff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e414eda0 con 0x7f86e406d570 2023-06-23T18:49:32.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86eb0ff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e406ea50 con 0x7f86e4070a30 2023-06-23T18:49:32.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86eb0ff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e414ea30 con 0x7f86e406b120 2023-06-23T18:49:32.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e969c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f86e406d570 0x7f86e406d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55894/0 (socket says 172.21.15.38:55894) 2023-06-23T18:49:32.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e969c640 1 -- 172.21.15.38:0/1670194162 learned_addr learned my addr 172.21.15.38:0/1670194162 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:32.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e8e9b640 1 --2- 172.21.15.38:0/1670194162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373497684 0 0) 0x7f86e414eda0 con 0x7f86e406d570 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d4003530 con 0x7f86e406d570 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365537083 0 0) 0x7f86e406ea50 con 0x7f86e4070a30 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e414eda0 con 0x7f86e4070a30 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e8e9b640 1 -- 172.21.15.38:0/1670194162 >> v1:172.21.15.81:6789/0 conn(0x7f86e4070a30 legacy=0x7f86e4070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e8e9b640 1 -- 172.21.15.38:0/1670194162 >> v1:172.21.15.38:6789/0 conn(0x7f86e406d570 legacy=0x7f86e406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e8e9b640 1 -- 172.21.15.38:0/1670194162 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4070750 con 0x7f86e406b120 2023-06-23T18:49:32.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e8e9b640 1 --2- 172.21.15.38:0/1670194162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e4070e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f86d80097f0 tx=0x7f86d801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=878f10bee4eeeace server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80ab650 con 0x7f86e406b120 2023-06-23T18:49:32.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d80ab7b0 con 0x7f86e406b120 2023-06-23T18:49:32.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.487+0000 7f86e37fe640 1 -- 172.21.15.38:0/1670194162 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80abb20 con 0x7f86e406b120 2023-06-23T18:49:32.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1670194162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 msgr2=0x7f86e4070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1670194162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e4070e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f86d80097f0 tx=0x7f86d801c430 comp rx=0 tx=0).stop 2023-06-23T18:49:32.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1670194162 shutdown_connections 2023-06-23T18:49:32.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1670194162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e4070e30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1670194162 >> 172.21.15.38:0/1670194162 conn(0x7f86e40c1fb0 msgr2=0x7f86e40c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:32.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1670194162 shutdown_connections 2023-06-23T18:49:32.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1670194162 wait complete. 2023-06-23T18:49:32.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 Processor -- start 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- start start 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e40bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e406d570 0x7f86e412df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41496a0 con 0x7f86e4148d70 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40bd980 con 0x7f86e406d570 2023-06-23T18:49:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40bd420 con 0x7f86e406b120 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42592/0 (socket says 172.21.15.38:42592) 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 -- 172.21.15.38:0/1325075294 learned_addr learned my addr 172.21.15.38:0/1325075294 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e8e9b640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e40bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e3fff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e406d570 0x7f86e412df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 -- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 msgr2=0x7f86e40bcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e40bcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 -- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e406d570 msgr2=0x7f86e412df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e406d570 0x7f86e412df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 -- 172.21.15.38:0/1325075294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8009420 con 0x7f86e4148d70 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e969c640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cbd0 tx=0x7f86dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00ace0 con 0x7f86e4148d70 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00ae40 con 0x7f86e4148d70 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40bdbd0 con 0x7f86e4148d70 2023-06-23T18:49:32.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc012620 con 0x7f86e4148d70 2023-06-23T18:49:32.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40be190 con 0x7f86e4148d70 2023-06-23T18:49:32.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.491+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40be3b0 con 0x7f86e4148d70 2023-06-23T18:49:32.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.495+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86dc007070 con 0x7f86e4148d70 2023-06-23T18:49:32.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.495+0000 7f86e17fa640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.495+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f86dc083bd0 con 0x7f86e4148d70 2023-06-23T18:49:32.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.495+0000 7f86e8e9b640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.495+0000 7f86e8e9b640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 0x7f86c8068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86d80af000 tx=0x7f86d80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.499+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86dc054ef0 con 0x7f86e4148d70 2023-06-23T18:49:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.651+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e404d790 con 0x7f86e4148d70 2023-06-23T18:49:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.655+0000 7f86e17fa640 1 -- 172.21.15.38:0/1325075294 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14603 (secure 0 0 0) 0x7f86dc054a80 con 0x7f86e4148d70 2023-06-23T18:49:32.662 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:32.662 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:32.307262+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.655+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 msgr2=0x7f86c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.655+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 0x7f86c8068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86d80af000 tx=0x7f86d80a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.655+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 msgr2=0x7f86e412e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.655+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cbd0 tx=0x7f86dc00a430 comp rx=0 tx=0).stop 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 shutdown_connections 2023-06-23T18:49:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e4148d70 0x7f86e412e450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e406d570 0x7f86e412df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 --2- 172.21.15.38:0/1325075294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e406b120 0x7f86e40bcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 >> 172.21.15.38:0/1325075294 conn(0x7f86e40c1fb0 msgr2=0x7f86e4070020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 shutdown_connections 2023-06-23T18:49:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.659+0000 7f86eb0ff640 1 -- 172.21.15.38:0/1325075294 wait complete. 2023-06-23T18:49:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:49:32.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:49:32.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 Processor -- start 2023-06-23T18:49:32.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 -- start start 2023-06-23T18:49:32.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 0x7f24600c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c23a0 con 0x7f24600bf1a0 2023-06-23T18:49:32.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24600aa080 con 0x7f24600be890 2023-06-23T18:49:32.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2465807640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600bb060 con 0x7f24600a3850 2023-06-23T18:49:32.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 0x7f24600c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2457fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f24600bf1a0 0x7f246006a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:51562/0 (socket says 172.21.15.38:51562) 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245f7fe640 1 -- 172.21.15.38:0/3945971584 learned_addr learned my addr 172.21.15.38:0/3945971584 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245e7fc640 1 -- 172.21.15.38:0/3945971584 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874503923 0 0) 0x7f24600c23a0 con 0x7f24600bf1a0 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245e7fc640 1 -- 172.21.15.38:0/3945971584 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c003530 con 0x7f24600bf1a0 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2457fff640 1 -- 172.21.15.38:0/3945971584 >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 msgr2=0x7f24600c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2457fff640 1 --2- 172.21.15.38:0/3945971584 >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 0x7f24600c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2457fff640 1 -- 172.21.15.38:0/3945971584 >> v1:172.21.15.81:6789/0 conn(0x7f24600bf1a0 legacy=0x7f246006a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f2457fff640 1 -- 172.21.15.38:0/3945971584 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600c3b60 con 0x7f24600a3850 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.799+0000 7f245effd640 1 --2- 172.21.15.38:0/3945971584 >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 0x7f24600c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2457fff640 1 --2- 172.21.15.38:0/3945971584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600bec60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f24480097f0 tx=0x7f244801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2bf2f1ee08693a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f245e7fc640 1 -- 172.21.15.38:0/3945971584 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480ad680 con 0x7f24600a3850 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f245e7fc640 1 -- 172.21.15.38:0/3945971584 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480ad7e0 con 0x7f24600a3850 2023-06-23T18:49:32.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f245e7fc640 1 -- 172.21.15.38:0/3945971584 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480adb70 con 0x7f24600a3850 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- 172.21.15.38:0/3945971584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 msgr2=0x7f24600bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 --2- 172.21.15.38:0/3945971584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600bec60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f24480097f0 tx=0x7f244801c360 comp rx=0 tx=0).stop 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- 172.21.15.38:0/3945971584 shutdown_connections 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 --2- 172.21.15.38:0/3945971584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600bec60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 --2- 172.21.15.38:0/3945971584 >> v2:172.21.15.81:3300/0 conn(0x7f24600be890 0x7f24600c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- 172.21.15.38:0/3945971584 >> 172.21.15.38:0/3945971584 conn(0x7f24600a5d50 msgr2=0x7f24600a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- 172.21.15.38:0/3945971584 shutdown_connections 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- 172.21.15.38:0/3945971584 wait complete. 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 Processor -- start 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.803+0000 7f2465807640 1 -- start start 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f246014cdd0 0x7f246014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601572d0 con 0x7f24600be890 2023-06-23T18:49:32.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246014f120 con 0x7f246014cdd0 2023-06-23T18:49:32.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a5470 con 0x7f24600a3850 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42608/0 (socket says 172.21.15.38:42608) 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 -- 172.21.15.38:0/168243174 learned_addr learned my addr 172.21.15.38:0/168243174 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245effd640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245f7fe640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f246014cdd0 0x7f246014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 -- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 msgr2=0x7f24600a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 -- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f246014cdd0 msgr2=0x7f246014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f246014cdd0 0x7f246014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 -- 172.21.15.38:0/168243174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450009420 con 0x7f24600be890 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2457fff640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2448019f90 tx=0x7f2448019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480add60 con 0x7f24600be890 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480b6410 con 0x7f24600be890 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480b67c0 con 0x7f24600be890 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2448009420 con 0x7f24600be890 2023-06-23T18:49:32.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24600bb7b0 con 0x7f24600be890 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246004d790 con 0x7f24600be890 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24480b4040 con 0x7f24600be890 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 0x7f2440068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f244811dc40 con 0x7f24600be890 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.807+0000 7f245effd640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 0x7f2440068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:32.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.811+0000 7f245effd640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 0x7f2440068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2450009cf0 tx=0x7f2450009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:32.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.811+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24480eb5e0 con 0x7f24600be890 2023-06-23T18:49:32.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24600a9890 con 0x7f24600be890 2023-06-23T18:49:32.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f245cff9640 1 -- 172.21.15.38:0/168243174 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24480eec00 con 0x7f24600be890 2023-06-23T18:49:32.973 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:49:32.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 msgr2=0x7f2440068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 0x7f2440068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2450009cf0 tx=0x7f2450009190 comp rx=0 tx=0).stop 2023-06-23T18:49:32.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 msgr2=0x7f24601575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:32.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2448019f90 tx=0x7f2448019100 comp rx=0 tx=0).stop 2023-06-23T18:49:32.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 shutdown_connections 2023-06-23T18:49:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2440066280 0x7f2440068730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f246014cdd0 0x7f246014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24600be890 0x7f24601575b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 --2- 172.21.15.38:0/168243174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24600a3850 0x7f24600a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:32.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 >> 172.21.15.38:0/168243174 conn(0x7f24600a5d50 msgr2=0x7f246006a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 shutdown_connections 2023-06-23T18:49:32.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:32.967+0000 7f2465807640 1 -- 172.21.15.38:0/168243174 wait complete. 2023-06-23T18:49:32.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:49:33.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 Processor -- start 2023-06-23T18:49:33.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 -- start start 2023-06-23T18:49:33.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24980a3270 0x7f2498158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24980c23a0 con 0x7f24980be890 2023-06-23T18:49:33.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24980bf370 con 0x7f24980a3850 2023-06-23T18:49:33.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f24a039d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24980c1490 con 0x7f24980a3270 2023-06-23T18:49:33.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f24980be890 0x7f24980c0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55898/0 (socket says 172.21.15.38:55898) 2023-06-23T18:49:33.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 -- 172.21.15.38:0/2172657704 learned_addr learned my addr 172.21.15.38:0/2172657704 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:33.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e93a640 1 --2- 172.21.15.38:0/2172657704 >> v2:172.21.15.81:3300/0 conn(0x7f24980a3270 0x7f2498158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298388444 0 0) 0x7f24980c23a0 con 0x7f24980be890 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2484003530 con 0x7f24980be890 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812609860 0 0) 0x7f2484003530 con 0x7f24980be890 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 >> v2:172.21.15.81:3300/0 conn(0x7f24980a3270 msgr2=0x7f2498158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 --2- 172.21.15.38:0/2172657704 >> v2:172.21.15.81:3300/0 conn(0x7f24980a3270 0x7f2498158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 >> v1:172.21.15.81:6789/0 conn(0x7f24980a3850 legacy=0x7f24980bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980aa080 con 0x7f24980be890 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f2494001680 con 0x7f24980be890 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 >> v1:172.21.15.38:6789/0 conn(0x7f24980be890 legacy=0x7f24980c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f2484003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24840047d0 0x7f2484004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484005380 0x7f248400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248400c1f0 con 0x7f24840039b0 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248400c360 con 0x7f2484005380 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248400c520 con 0x7f24840047d0 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f2484003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e93a640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484005380 0x7f248400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 -- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24840047d0 msgr2=0x7f2484004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249d938640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24840047d0 0x7f2484004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24840047d0 0x7f2484004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 -- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484005380 msgr2=0x7f248400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484005380 0x7f248400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e139640 1 -- 172.21.15.38:0/2172657704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484003530 con 0x7f24840039b0 2023-06-23T18:49:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e93a640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484005380 0x7f248400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.103+0000 7f249e93a640 1 -- 172.21.15.38:0/2172657704 reap_dead start 2023-06-23T18:49:33.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f2484003dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f249400c240 tx=0x7f249401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d041fad7f7ee7c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494005ae0 con 0x7f24840039b0 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494005c40 con 0x7f24840039b0 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249d137640 1 -- 172.21.15.38:0/2172657704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5a70 con 0x7f24840039b0 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 msgr2=0x7f2484003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f2484003dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f249400c240 tx=0x7f249401cc40 comp rx=0 tx=0).stop 2023-06-23T18:49:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- 172.21.15.38:0/2172657704 shutdown_connections 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 --2- 172.21.15.38:0/2172657704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f2484003dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- 172.21.15.38:0/2172657704 >> 172.21.15.38:0/2172657704 conn(0x7f24980a5d50 msgr2=0x7f24980a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- 172.21.15.38:0/2172657704 shutdown_connections 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- 172.21.15.38:0/2172657704 wait complete. 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 Processor -- start 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- start start 2023-06-23T18:49:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24981e9b90 0x7f249814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 0x7f249814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249814aec0 con 0x7f24840039b0 2023-06-23T18:49:33.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24981ea830 con 0x7f24981e9b90 2023-06-23T18:49:33.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f24a039d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249814ef60 con 0x7f24981ea000 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42628/0 (socket says 172.21.15.38:42628) 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 -- 172.21.15.38:0/2493666339 learned_addr learned my addr 172.21.15.38:0/2493666339 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e93a640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 0x7f249814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249d938640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24981e9b90 0x7f249814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 -- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 msgr2=0x7f249814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 0x7f249814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 -- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24981e9b90 msgr2=0x7f249814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24981e9b90 0x7f249814a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 -- 172.21.15.38:0/2493666339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980bc310 con 0x7f24840039b0 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e93a640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 0x7f249814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:33.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.107+0000 7f249e139640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f249400c240 tx=0x7f2484005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940b4070 con 0x7f24840039b0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494001440 con 0x7f24840039b0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24981ea550 con 0x7f24840039b0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5830 con 0x7f24840039b0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249814a860 con 0x7f24840039b0 2023-06-23T18:49:33.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249804d790 con 0x7f24840039b0 2023-06-23T18:49:33.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24940a5990 con 0x7f24840039b0 2023-06-23T18:49:33.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 0x7f247c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f249411d670 con 0x7f24840039b0 2023-06-23T18:49:33.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f249d938640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 0x7f247c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.111+0000 7f249d938640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 0x7f247c068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24980bb3c0 tx=0x7f2488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.115+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24940eaed0 con 0x7f24840039b0 2023-06-23T18:49:33.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.263+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f249814f0a0 con 0x7f24840039b0 2023-06-23T18:49:33.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.263+0000 7f248effd640 1 -- 172.21.15.38:0/2493666339 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24940ad3c0 con 0x7f24840039b0 2023-06-23T18:49:33.270 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:49:33.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 msgr2=0x7f247c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 0x7f247c068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24980bb3c0 tx=0x7f2488009040 comp rx=0 tx=0).stop 2023-06-23T18:49:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 msgr2=0x7f24980bbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f249400c240 tx=0x7f2484005800 comp rx=0 tx=0).stop 2023-06-23T18:49:33.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 shutdown_connections 2023-06-23T18:49:33.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f247c066280 0x7f247c068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24981ea000 0x7f249814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24981e9b90 0x7f249814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 --2- 172.21.15.38:0/2493666339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24840039b0 0x7f24980bbdd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 >> 172.21.15.38:0/2493666339 conn(0x7f24980a5d50 msgr2=0x7f24980a5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 shutdown_connections 2023-06-23T18:49:33.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.267+0000 7f24a039d640 1 -- 172.21.15.38:0/2493666339 wait complete. 2023-06-23T18:49:33.287 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:49:33.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.395+0000 7fdf244ca640 1 Processor -- start 2023-06-23T18:49:33.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.395+0000 7fdf244ca640 1 -- start start 2023-06-23T18:49:33.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c152830 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0bf350 con 0x7fdf1c0bea40 2023-06-23T18:49:33.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c22a0 con 0x7fdf1c0c0c70 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42636/0 (socket says 172.21.15.38:42636) 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 -- 172.21.15.38:0/3614627784 learned_addr learned my addr 172.21.15.38:0/3614627784 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22a67640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 -- 172.21.15.38:0/3614627784 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 msgr2=0x7fdf1c0bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:33.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 -- 172.21.15.38:0/3614627784 >> v1:172.21.15.81:6789/0 conn(0x7fdf1c0a30c0 legacy=0x7fdf1c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 -- 172.21.15.38:0/3614627784 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c0c2870 con 0x7fdf1c0bea40 2023-06-23T18:49:33.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf22266640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009870 tx=0x7fdf1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b565e48194200b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf21264640 1 -- 172.21.15.38:0/3614627784 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab600 con 0x7fdf1c0bea40 2023-06-23T18:49:33.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf21264640 1 -- 172.21.15.38:0/3614627784 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100a7050 con 0x7fdf1c0bea40 2023-06-23T18:49:33.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf21264640 1 -- 172.21.15.38:0/3614627784 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab980 con 0x7fdf1c0bea40 2023-06-23T18:49:33.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- 172.21.15.38:0/3614627784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0bea40 msgr2=0x7fdf1c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009870 tx=0x7fdf1001c480 comp rx=0 tx=0).stop 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- 172.21.15.38:0/3614627784 shutdown_connections 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 --2- 172.21.15.38:0/3614627784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0a35f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- 172.21.15.38:0/3614627784 >> 172.21.15.38:0/3614627784 conn(0x7fdf1c0a5cc0 msgr2=0x7fdf1c0a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- 172.21.15.38:0/3614627784 shutdown_connections 2023-06-23T18:49:33.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.399+0000 7fdf244ca640 1 -- 172.21.15.38:0/3614627784 wait complete. 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 Processor -- start 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 -- start start 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0a7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0a88d0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0a7540 con 0x7fdf1c0bea40 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf244ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1470c0 con 0x7fdf1c0c0c70 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42648/0 (socket says 172.21.15.38:42648) 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 -- 172.21.15.38:0/1644896153 learned_addr learned my addr 172.21.15.38:0/1644896153 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22a67640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf21a65640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 -- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 msgr2=0x7fdf1c0a7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0a7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 -- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c0bea40 msgr2=0x7fdf1c0b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 -- 172.21.15.38:0/1644896153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100094d0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf22266640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf1001ab30 tx=0x7fdf10019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100b6640 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100b67a0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.403+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100b6b50 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c0b9ff0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c0a3820 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c0a6fc0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf100b2040 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf0effd640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 0x7fdf00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdf1011d840 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf21a65640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 0x7fdf00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.407+0000 7fdf21a65640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 0x7fdf00068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0bef80 tx=0x7fdf18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.411+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf1c0a6fc0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.599+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf1c0a6fc0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.599+0000 7fdf0effd640 1 -- 172.21.15.38:0/1644896153 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2012 (secure 0 0 0) 0x7fdf1c0a6fc0 con 0x7fdf1c0a30c0 2023-06-23T18:49:33.606 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:33.606 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-06-23T18:49:33.607 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2023-06-23T18:49:33.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.599+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 msgr2=0x7fdf00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.599+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 0x7fdf00068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0bef80 tx=0x7fdf18009040 comp rx=0 tx=0).stop 2023-06-23T18:49:33.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 msgr2=0x7fdf1c0b9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf1001ab30 tx=0x7fdf10019220 comp rx=0 tx=0).stop 2023-06-23T18:49:33.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 shutdown_connections 2023-06-23T18:49:33.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf00066280 0x7fdf00068730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0c70 0x7fdf1c0a7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c0bea40 0x7fdf1c0b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 --2- 172.21.15.38:0/1644896153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf1c0a30c0 0x7fdf1c0b9ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 >> 172.21.15.38:0/1644896153 conn(0x7fdf1c0a5cc0 msgr2=0x7fdf1c149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 shutdown_connections 2023-06-23T18:49:33.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.603+0000 7fdf244ca640 1 -- 172.21.15.38:0/1644896153 wait complete. 2023-06-23T18:49:33.624 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:33.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 Processor -- start 2023-06-23T18:49:33.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 -- start start 2023-06-23T18:49:33.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb180bc2e0 0x7fbb180ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1806e1f0 con 0x7fbb1806c6d0 2023-06-23T18:49:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1806e4d0 con 0x7fbb18152300 2023-06-23T18:49:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb20622640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1806e7b0 con 0x7fbb180bc2e0 2023-06-23T18:49:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb180bc2e0 0x7fbb180ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb180bc2e0 0x7fbb180ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42650/0 (socket says 172.21.15.38:42650) 2023-06-23T18:49:33.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 -- 172.21.15.38:0/3807626154 learned_addr learned my addr 172.21.15.38:0/3807626154 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:33.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1e3be640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbb1806c6d0 0x7fbb18151bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55900/0 (socket says 172.21.15.38:55900) 2023-06-23T18:49:33.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 -- 172.21.15.38:0/3807626154 >> v1:172.21.15.81:6789/0 conn(0x7fbb18152300 legacy=0x7fbb180700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:33.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 -- 172.21.15.38:0/3807626154 >> v1:172.21.15.38:6789/0 conn(0x7fbb1806c6d0 legacy=0x7fbb18151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.739+0000 7fbb1dbbd640 1 -- 172.21.15.38:0/3807626154 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18152740 con 0x7fbb180bc2e0 2023-06-23T18:49:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1dbbd640 1 --2- 172.21.15.38:0/3807626154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb180bc2e0 0x7fbb180ba2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009870 tx=0x7fbb0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8b131d3efe6fab server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1d3bc640 1 -- 172.21.15.38:0/3807626154 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ab600 con 0x7fbb180bc2e0 2023-06-23T18:49:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1d3bc640 1 -- 172.21.15.38:0/3807626154 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080a7050 con 0x7fbb180bc2e0 2023-06-23T18:49:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1d3bc640 1 -- 172.21.15.38:0/3807626154 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ab980 con 0x7fbb180bc2e0 2023-06-23T18:49:33.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- 172.21.15.38:0/3807626154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb180bc2e0 msgr2=0x7fbb180ba2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 --2- 172.21.15.38:0/3807626154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb180bc2e0 0x7fbb180ba2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009870 tx=0x7fbb0801c500 comp rx=0 tx=0).stop 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- 172.21.15.38:0/3807626154 shutdown_connections 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 --2- 172.21.15.38:0/3807626154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb180bc2e0 0x7fbb180ba2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- 172.21.15.38:0/3807626154 >> 172.21.15.38:0/3807626154 conn(0x7fbb180c0c90 msgr2=0x7fbb180bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- 172.21.15.38:0/3807626154 shutdown_connections 2023-06-23T18:49:33.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- 172.21.15.38:0/3807626154 wait complete. 2023-06-23T18:49:33.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 Processor -- start 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- start start 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb1806c6d0 0x7fbb181489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb180bc2e0 0x7fbb18146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180bfd00 con 0x7fbb18152300 2023-06-23T18:49:33.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18147ec0 con 0x7fbb180bc2e0 2023-06-23T18:49:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb20622640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181564f0 con 0x7fbb1806c6d0 2023-06-23T18:49:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1ebbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1ebbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42656/0 (socket says 172.21.15.38:42656) 2023-06-23T18:49:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1ebbf640 1 -- 172.21.15.38:0/1293145826 learned_addr learned my addr 172.21.15.38:0/1293145826 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:33.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1dbbd640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb180bc2e0 0x7fbb18146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1ebbf640 1 -- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb1806c6d0 msgr2=0x7fbb181489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.743+0000 7fbb1ebbf640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb1806c6d0 0x7fbb181489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1ebbf640 1 -- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb180bc2e0 msgr2=0x7fbb18146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1ebbf640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb180bc2e0 0x7fbb18146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1ebbf640 1 -- 172.21.15.38:0/1293145826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080094d0 con 0x7fbb18152300 2023-06-23T18:49:33.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1ebbf640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000b990 tx=0x7fbb1000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000cba0 con 0x7fbb18152300 2023-06-23T18:49:33.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000cd00 con 0x7fbb18152300 2023-06-23T18:49:33.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb181480b0 con 0x7fbb18152300 2023-06-23T18:49:33.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10014680 con 0x7fbb18152300 2023-06-23T18:49:33.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb18146b90 con 0x7fbb18152300 2023-06-23T18:49:33.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18146e10 con 0x7fbb18152300 2023-06-23T18:49:33.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb100147e0 con 0x7fbb18152300 2023-06-23T18:49:33.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 0x7fbafc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:33.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb10083960 con 0x7fbb18152300 2023-06-23T18:49:33.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1e3be640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 0x7fbafc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:33.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.747+0000 7fbb1e3be640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 0x7fbafc068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb140015f0 tx=0x7fbb140079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:33.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.751+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb10051130 con 0x7fbb18152300 2023-06-23T18:49:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.899+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb18156630 con 0x7fbb18152300 2023-06-23T18:49:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb0effd640 1 -- 172.21.15.38:0/1293145826 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14590 (secure 0 0 0) 0x7fbb18156630 con 0x7fbb18152300 2023-06-23T18:49:33.909 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:33.909 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:33.320754+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 msgr2=0x7fbafc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 0x7fbafc068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb140015f0 tx=0x7fbb140079d0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 msgr2=0x7fbb1813cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000b990 tx=0x7fbb1000be50 comp rx=0 tx=0).stop 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 shutdown_connections 2023-06-23T18:49:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbafc066280 0x7fbafc068730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb18152300 0x7fbb1813cde0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb180bc2e0 0x7fbb18146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 --2- 172.21.15.38:0/1293145826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbb1806c6d0 0x7fbb181489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 >> 172.21.15.38:0/1293145826 conn(0x7fbb180c0c90 msgr2=0x7fbb180ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 shutdown_connections 2023-06-23T18:49:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:33.903+0000 7fbb20622640 1 -- 172.21.15.38:0/1293145826 wait complete. 2023-06-23T18:49:33.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:49:33.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:49:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 Processor -- start 2023-06-23T18:49:34.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 -- start start 2023-06-23T18:49:34.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf6c0ba7f0 0x7fcf6c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 0x7fcf6c1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c1504e0 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c070270 con 0x7fcf6c0ba7f0 2023-06-23T18:49:34.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf7311a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c149c30 con 0x7fcf6c149270 2023-06-23T18:49:34.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42660/0 (socket says 172.21.15.38:42660) 2023-06-23T18:49:34.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 -- 172.21.15.38:0/3104928722 learned_addr learned my addr 172.21.15.38:0/3104928722 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf716b7640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 0x7fcf6c1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 -- 172.21.15.38:0/3104928722 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 msgr2=0x7fcf6c1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 0x7fcf6c1496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 -- 172.21.15.38:0/3104928722 >> v2:172.21.15.81:3300/0 conn(0x7fcf6c0ba7f0 msgr2=0x7fcf6c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf6bfff640 1 --2- 172.21.15.38:0/3104928722 >> v2:172.21.15.81:3300/0 conn(0x7fcf6c0ba7f0 0x7fcf6c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/3104928722 >> v2:172.21.15.81:3300/0 conn(0x7fcf6c0ba7f0 0x7fcf6c14bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf70eb6640 1 -- 172.21.15.38:0/3104928722 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c14ff20 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.035+0000 7fcf716b7640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 0x7fcf6c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:34.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0738a0 tx=0x7fcf5c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20aac1ba527ed292 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf6b7fe640 1 -- 172.21.15.38:0/3104928722 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0ab600 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf6b7fe640 1 -- 172.21.15.38:0/3104928722 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c0a7050 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf6b7fe640 1 -- 172.21.15.38:0/3104928722 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0ab980 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- 172.21.15.38:0/3104928722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c06c4b0 msgr2=0x7fcf6c0c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0738a0 tx=0x7fcf5c01c470 comp rx=0 tx=0).stop 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- 172.21.15.38:0/3104928722 shutdown_connections 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c149270 0x7fcf6c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- 172.21.15.38:0/3104928722 >> v2:172.21.15.81:3300/0 conn(0x7fcf6c0ba7f0 0x7fcf6c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- 172.21.15.38:0/3104928722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c0c09d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- 172.21.15.38:0/3104928722 >> 172.21.15.38:0/3104928722 conn(0x7fcf6c0bfe30 msgr2=0x7fcf6c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- 172.21.15.38:0/3104928722 shutdown_connections 2023-06-23T18:49:34.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- 172.21.15.38:0/3104928722 wait complete. 2023-06-23T18:49:34.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 Processor -- start 2023-06-23T18:49:34.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- start start 2023-06-23T18:49:34.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c1e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 0x7fcf6c13add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c14ce70 con 0x7fcf6c149270 2023-06-23T18:49:34.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c146450 con 0x7fcf6c06c4b0 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf7311a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c146730 con 0x7fcf6c0ba7f0 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf716b7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf716b7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42662/0 (socket says 172.21.15.38:42662) 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf716b7640 1 -- 172.21.15.38:0/2244856833 learned_addr learned my addr 172.21.15.38:0/2244856833 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.039+0000 7fcf6bfff640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 0x7fcf6c13add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 -- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 msgr2=0x7fcf6c13add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 0x7fcf6c13add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 -- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c06c4b0 msgr2=0x7fcf6c1e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c1e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c1e4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 -- 172.21.15.38:0/2244856833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0094d0 con 0x7fcf6c149270 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf6bfff640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 0x7fcf6c13add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf716b7640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400cd50 tx=0x7fcf6400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6400f680 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6400f800 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c146a10 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6400fbb0 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c142c00 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c04d790 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf6400b040 con 0x7fcf6c149270 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 0x7fcf4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf64084390 con 0x7fcf6c149270 2023-06-23T18:49:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 0x7fcf4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.043+0000 7fcf70eb6640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 0x7fcf4c068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c06dc30 tx=0x7fcf5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.047+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf64051bf0 con 0x7fcf6c149270 2023-06-23T18:49:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.195+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf6c1e4760 con 0x7fcf6c149270 2023-06-23T18:49:34.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.195+0000 7fcf697fa640 1 -- 172.21.15.38:0/2244856833 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf64055210 con 0x7fcf6c149270 2023-06-23T18:49:34.202 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:49:34.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 msgr2=0x7fcf4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 0x7fcf4c068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c06dc30 tx=0x7fcf5c008040 comp rx=0 tx=0).stop 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 msgr2=0x7fcf6c13e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400cd50 tx=0x7fcf6400a650 comp rx=0 tx=0).stop 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 shutdown_connections 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf4c0662b0 0x7fcf4c068760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf6c149270 0x7fcf6c13e220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf6c0ba7f0 0x7fcf6c13add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 --2- 172.21.15.38:0/2244856833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c06c4b0 0x7fcf6c1e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 >> 172.21.15.38:0/2244856833 conn(0x7fcf6c0bfe30 msgr2=0x7fcf6c0bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 shutdown_connections 2023-06-23T18:49:34.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.199+0000 7fcf7311a640 1 -- 172.21.15.38:0/2244856833 wait complete. 2023-06-23T18:49:34.220 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:49:34.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.335+0000 7f214cc39640 1 Processor -- start 2023-06-23T18:49:34.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 -- start start 2023-06-23T18:49:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 0x7f21480a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2148144e90 0x7f21480be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214814b740 con 0x7f21480a37d0 2023-06-23T18:49:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214814ba20 con 0x7f2148144e90 2023-06-23T18:49:34.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214cc39640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480a2160 con 0x7f214806ca50 2023-06-23T18:49:34.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2148144e90 0x7f21480be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2148144e90 0x7f21480be960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42666/0 (socket says 172.21.15.38:42666) 2023-06-23T18:49:34.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 -- 172.21.15.38:0/3680703874 learned_addr learned my addr 172.21.15.38:0/3680703874 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214659c640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 0x7f21480a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 -- 172.21.15.38:0/3680703874 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 msgr2=0x7f21480a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 0x7f21480a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 -- 172.21.15.38:0/3680703874 >> v1:172.21.15.81:6789/0 conn(0x7f21480a37d0 legacy=0x7f2148144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 -- 172.21.15.38:0/3680703874 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214806ce20 con 0x7f2148144e90 2023-06-23T18:49:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214659c640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 0x7f21480a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f2146d9d640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f21480be960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2140009e50 tx=0x7f214001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a910c1709795a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.339+0000 7f214559a640 1 -- 172.21.15.38:0/3680703874 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400a5630 con 0x7f2148144e90 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214559a640 1 -- 172.21.15.38:0/3680703874 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400a5790 con 0x7f2148144e90 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214559a640 1 -- 172.21.15.38:0/3680703874 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400a5b20 con 0x7f2148144e90 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3680703874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 msgr2=0x7f21480be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f21480be960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2140009e50 tx=0x7f214001c980 comp rx=0 tx=0).stop 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3680703874 shutdown_connections 2023-06-23T18:49:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f21480be960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- 172.21.15.38:0/3680703874 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f214806ca50 0x7f21480a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3680703874 >> 172.21.15.38:0/3680703874 conn(0x7f21480c06c0 msgr2=0x7f21480c0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3680703874 shutdown_connections 2023-06-23T18:49:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3680703874 wait complete. 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 Processor -- start 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- start start 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214806ca50 0x7f214813e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21480a37d0 0x7f2148070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148133fa0 con 0x7f2148144e90 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148133d50 con 0x7f214806ca50 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21481ea170 con 0x7f21480a37d0 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42678/0 (socket says 172.21.15.38:42678) 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 -- 172.21.15.38:0/3330775315 learned_addr learned my addr 172.21.15.38:0/3330775315 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214659c640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214806ca50 0x7f214813e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2145d9b640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21480a37d0 0x7f2148070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 -- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21480a37d0 msgr2=0x7f2148070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21480a37d0 0x7f2148070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 -- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214806ca50 msgr2=0x7f214813e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214806ca50 0x7f214813e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 -- 172.21.15.38:0/3330775315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140009b30 con 0x7f2148144e90 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2146d9d640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f214001a5b0 tx=0x7f2140019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400a5630 con 0x7f2148144e90 2023-06-23T18:49:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140007bb0 con 0x7f2148144e90 2023-06-23T18:49:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2148069750 con 0x7f2148144e90 2023-06-23T18:49:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140009510 con 0x7f2148144e90 2023-06-23T18:49:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.343+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21481ea600 con 0x7f2148144e90 2023-06-23T18:49:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148133800 con 0x7f2148144e90 2023-06-23T18:49:34.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21400b8470 con 0x7f2148144e90 2023-06-23T18:49:34.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f2136ffd640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 0x7f2128068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f214011f460 con 0x7f2148144e90 2023-06-23T18:49:34.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f214659c640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 0x7f2128068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.347+0000 7f214659c640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 0x7f2128068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c900 tx=0x7f213c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.351+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21400ecd60 con 0x7f2148144e90 2023-06-23T18:49:34.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.503+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2148133800 con 0x7f2148144e90 2023-06-23T18:49:34.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.503+0000 7f2136ffd640 1 -- 172.21.15.38:0/3330775315 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2148133800 con 0x7f2148144e90 2023-06-23T18:49:34.512 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:49:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 msgr2=0x7f2128068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 0x7f2128068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c900 tx=0x7f213c008040 comp rx=0 tx=0).stop 2023-06-23T18:49:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 msgr2=0x7f2148071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f214001a5b0 tx=0x7f2140019720 comp rx=0 tx=0).stop 2023-06-23T18:49:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 shutdown_connections 2023-06-23T18:49:34.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2128066280 0x7f2128068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2148144e90 0x7f2148071280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21480a37d0 0x7f2148070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 --2- 172.21.15.38:0/3330775315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214806ca50 0x7f214813e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 >> 172.21.15.38:0/3330775315 conn(0x7f21480c06c0 msgr2=0x7f214813e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 shutdown_connections 2023-06-23T18:49:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.507+0000 7f214cc39640 1 -- 172.21.15.38:0/3330775315 wait complete. 2023-06-23T18:49:34.530 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T18:49:34.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 Processor -- start 2023-06-23T18:49:34.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 -- start start 2023-06-23T18:49:34.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1cc06c6d0 0x7ff1cc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1cc0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0b9ca0 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0714a0 con 0x7ff1cc06c6d0 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d3179640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc06a3f0 con 0x7ff1cc0bd9b0 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d1716640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff1cc0bc4f0 0x7ff1cc14a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55908/0 (socket says 172.21.15.38:55908) 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d1716640 1 -- 172.21.15.38:0/1207482129 learned_addr learned my addr 172.21.15.38:0/1207482129 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:34.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/1207482129 >> v2:172.21.15.81:3300/0 conn(0x7ff1cc06c6d0 0x7ff1cc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1cc0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596759817 0 0) 0x7ff1cc0b9ca0 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b4003530 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538358715 0 0) 0x7ff1b4003530 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 msgr2=0x7ff1cc0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1cc0a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 >> v2:172.21.15.81:3300/0 conn(0x7ff1cc06c6d0 msgr2=0x7ff1cc070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 --2- 172.21.15.38:0/1207482129 >> v2:172.21.15.81:3300/0 conn(0x7ff1cc06c6d0 0x7ff1cc070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0ba390 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7ff1c4001680 con 0x7ff1cc0bc4f0 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 >> v1:172.21.15.38:6789/0 conn(0x7ff1cc0bc4f0 legacy=0x7ff1cc14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1b4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b4004d10 0x7ff1b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0714a0 con 0x7ff1b4003f00 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc06a3f0 con 0x7ff1b4004d10 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b400b9c0 con 0x7ff1cc0bd9b0 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1b4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d1716640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b4004d10 0x7ff1b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 -- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 msgr2=0x7ff1b4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1b4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 -- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b4004d10 msgr2=0x7ff1b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b4004d10 0x7ff1b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1cbfff640 1 -- 172.21.15.38:0/1207482129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4003530 con 0x7ff1b4003f00 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bd9b0 0x7ff1b4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:34.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.651+0000 7ff1d1716640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1b4004d10 0x7ff1b4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:34.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1b40047d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009fc0 tx=0x7ff1c001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89897bdf9c2385ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a5ae0 con 0x7ff1b4003f00 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000f040 con 0x7ff1b4003f00 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1cb7fe640 1 -- 172.21.15.38:0/1207482129 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a5e80 con 0x7ff1b4003f00 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- 172.21.15.38:0/1207482129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 msgr2=0x7ff1b40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 --2- 172.21.15.38:0/1207482129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1b40047d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009fc0 tx=0x7ff1c001cc00 comp rx=0 tx=0).stop 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d1716640 1 -- 172.21.15.38:0/1207482129 reap_dead start 2023-06-23T18:49:34.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- 172.21.15.38:0/1207482129 shutdown_connections 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- 172.21.15.38:0/1207482129 >> 172.21.15.38:0/1207482129 conn(0x7ff1cc0c0c90 msgr2=0x7ff1cc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- 172.21.15.38:0/1207482129 shutdown_connections 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- 172.21.15.38:0/1207482129 wait complete. 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 Processor -- start 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 -- start start 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bde10 0x7ff1cc141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.655+0000 7ff1d3179640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 0x7ff1cc140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc141830 con 0x7ff1b4003f00 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1411e0 con 0x7ff1cc0be280 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1414c0 con 0x7ff1cc0bde10 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42682/0 (socket says 172.21.15.38:42682) 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 -- 172.21.15.38:0/3207466186 learned_addr learned my addr 172.21.15.38:0/3207466186 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bde10 0x7ff1cc141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d1716640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 0x7ff1cc140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 -- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bde10 msgr2=0x7ff1cc141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bde10 0x7ff1cc141cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 -- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 msgr2=0x7ff1cc140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 0x7ff1cc140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 -- 172.21.15.38:0/3207466186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc1e5350 con 0x7ff1b4003f00 2023-06-23T18:49:34.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d1716640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 0x7ff1cc140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d0f15640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc010950 tx=0x7ff1bc010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00ec20 con 0x7ff1b4003f00 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00ed80 con 0x7ff1b4003f00 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc142200 con 0x7ff1b4003f00 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc004220 con 0x7ff1b4003f00 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc140ca0 con 0x7ff1b4003f00 2023-06-23T18:49:34.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc141680 con 0x7ff1b4003f00 2023-06-23T18:49:34.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1bc004380 con 0x7ff1b4003f00 2023-06-23T18:49:34.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1bc083980 con 0x7ff1b4003f00 2023-06-23T18:49:34.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.659+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.663+0000 7ff1cbfff640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 0x7ff1b8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00af000 tx=0x7ff1c0004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.663+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1bc051200 con 0x7ff1b4003f00 2023-06-23T18:49:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.819+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1cc140f50 con 0x7ff1b4003f00 2023-06-23T18:49:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.819+0000 7ff1c97fa640 1 -- 172.21.15.38:0/3207466186 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff1bc054820 con 0x7ff1b4003f00 2023-06-23T18:49:34.827 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-06-23T18:49:34.827 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-06-23T18:49:34.827 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-06-23T18:49:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-06-23T18:49:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 msgr2=0x7ff1b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 0x7ff1b8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00af000 tx=0x7ff1c0004ac0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 msgr2=0x7ff1cc1e4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc010950 tx=0x7ff1bc010e10 comp rx=0 tx=0).stop 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 shutdown_connections 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1cc0be280 0x7ff1cc140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff1cc0bde10 0x7ff1cc141cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 --2- 172.21.15.38:0/3207466186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1b4003f00 0x7ff1cc1e4330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 >> 172.21.15.38:0/3207466186 conn(0x7ff1cc0c0c90 msgr2=0x7ff1cc146910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 shutdown_connections 2023-06-23T18:49:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.823+0000 7ff1d3179640 1 -- 172.21.15.38:0/3207466186 wait complete. 2023-06-23T18:49:34.846 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T18:49:34.846 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T18:49:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 Processor -- start 2023-06-23T18:49:34.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 -- start start 2023-06-23T18:49:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f16040bd1e0 0x7f160414c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f160406a630 0x7f160414c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040ba9d0 con 0x7f160414b930 2023-06-23T18:49:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040bc300 con 0x7f16040bd1e0 2023-06-23T18:49:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f160b938640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040a5570 con 0x7f160406a630 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f16040bd1e0 0x7f160414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f16040bd1e0 0x7f160414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42688/0 (socket says 172.21.15.38:42688) 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 -- 172.21.15.38:0/3598101229 learned_addr learned my addr 172.21.15.38:0/3598101229 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1609ed5640 1 --2- 172.21.15.38:0/3598101229 >> v2:172.21.15.81:3300/0 conn(0x7f160406a630 0x7f160414c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 -- 172.21.15.38:0/3598101229 >> v2:172.21.15.81:3300/0 conn(0x7f160406a630 msgr2=0x7f160414c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 --2- 172.21.15.38:0/3598101229 >> v2:172.21.15.81:3300/0 conn(0x7f160406a630 0x7f160414c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 -- 172.21.15.38:0/3598101229 >> v1:172.21.15.81:6789/0 conn(0x7f160414b930 legacy=0x7f160406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.963+0000 7f1608ed3640 1 -- 172.21.15.38:0/3598101229 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604150160 con 0x7f16040bd1e0 2023-06-23T18:49:34.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f1608ed3640 1 --2- 172.21.15.38:0/3598101229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16040bd1e0 0x7f160414c390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16040b5060 tx=0x7f160001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78db44312372dd6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f15fbfff640 1 -- 172.21.15.38:0/3598101229 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000ab600 con 0x7f16040bd1e0 2023-06-23T18:49:34.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f15fbfff640 1 -- 172.21.15.38:0/3598101229 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16000a7050 con 0x7f16040bd1e0 2023-06-23T18:49:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f15fbfff640 1 -- 172.21.15.38:0/3598101229 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000ab980 con 0x7f16040bd1e0 2023-06-23T18:49:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- 172.21.15.38:0/3598101229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16040bd1e0 msgr2=0x7f160414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- 172.21.15.38:0/3598101229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16040bd1e0 0x7f160414c390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16040b5060 tx=0x7f160001c4c0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- 172.21.15.38:0/3598101229 shutdown_connections 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- 172.21.15.38:0/3598101229 >> v2:172.21.15.81:3300/0 conn(0x7f160406a630 0x7f160414c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- 172.21.15.38:0/3598101229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16040bd1e0 0x7f160414c390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- 172.21.15.38:0/3598101229 >> 172.21.15.38:0/3598101229 conn(0x7f16040c0c90 msgr2=0x7f16040bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- 172.21.15.38:0/3598101229 shutdown_connections 2023-06-23T18:49:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- 172.21.15.38:0/3598101229 wait complete. 2023-06-23T18:49:34.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 Processor -- start 2023-06-23T18:49:34.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- start start 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 0x7f16041e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f160414b930 0x7f160414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040b59a0 con 0x7f160406a630 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16041e4740 con 0x7f16040bd1e0 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f160b938640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16041e8520 con 0x7f160414b930 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42692/0 (socket says 172.21.15.38:42692) 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 -- 172.21.15.38:0/4239755902 learned_addr learned my addr 172.21.15.38:0/4239755902 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f1608ed3640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 0x7f16041e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f1609ed5640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f160414b930 0x7f160414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 -- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f160414b930 msgr2=0x7f160414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f160414b930 0x7f160414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 -- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 msgr2=0x7f16041e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 0x7f16041e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 -- 172.21.15.38:0/4239755902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000094d0 con 0x7f160406a630 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f1608ed3640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 0x7f16041e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.967+0000 7f16096d4640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c450 tx=0x7f15f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4012830 con 0x7f160406a630 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40129b0 con 0x7f160406a630 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160406cd00 con 0x7f160406a630 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4012d60 con 0x7f160406a630 2023-06-23T18:49:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16041e81d0 con 0x7f160406a630 2023-06-23T18:49:34.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160404d790 con 0x7f160406a630 2023-06-23T18:49:34.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15f401c460 con 0x7f160406a630 2023-06-23T18:49:34.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 0x7f15e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f15f40837c0 con 0x7f160406a630 2023-06-23T18:49:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f1608ed3640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 0x7f15e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.971+0000 7f1608ed3640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 0x7f15e8068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000ad000 tx=0x7f1600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:34.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:34.975+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15f4051020 con 0x7f160406a630 2023-06-23T18:49:35.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.123+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f160406caf0 con 0x7f160406a630 2023-06-23T18:49:35.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.351+0000 7f15f9ffb640 1 -- 172.21.15.38:0/4239755902 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f15f4054640 con 0x7f160406a630 2023-06-23T18:49:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-06-23T18:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 msgr2=0x7f15e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 0x7f15e8068760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16000ad000 tx=0x7f1600009040 comp rx=0 tx=0).stop 2023-06-23T18:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 msgr2=0x7f16040b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c450 tx=0x7f15f400c910 comp rx=0 tx=0).stop 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 shutdown_connections 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f15e80662b0 0x7f15e8068760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f160414b930 0x7f160414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16040bd1e0 0x7f16041e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 --2- 172.21.15.38:0/4239755902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f160406a630 0x7f16040b7060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 >> 172.21.15.38:0/4239755902 conn(0x7f16040c0c90 msgr2=0x7f160414c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:35.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 shutdown_connections 2023-06-23T18:49:35.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.355+0000 7f160b938640 1 -- 172.21.15.38:0/4239755902 wait complete. 2023-06-23T18:49:35.383 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-23T18:49:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 Processor -- start 2023-06-23T18:49:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 -- start start 2023-06-23T18:49:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bc720 0x7f36880a3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f368814e420 0x7f368814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880a2fc0 con 0x7f368814db10 2023-06-23T18:49:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368806e780 con 0x7f368814e420 2023-06-23T18:49:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368e468640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880a3d90 con 0x7f36880bc720 2023-06-23T18:49:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368ca05640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f368814e420 0x7f368814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f36877fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bc720 0x7f36880a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f3687fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f368814db10 0x7f36880c0920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:48138/0 (socket says 172.21.15.38:48138) 2023-06-23T18:49:35.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f3687fff640 1 -- 172.21.15.38:0/113709358 learned_addr learned my addr 172.21.15.38:0/113709358 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:35.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368ca05640 1 -- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bc720 msgr2=0x7f36880a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368ca05640 1 --2- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bc720 0x7f36880a3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368ca05640 1 -- 172.21.15.38:0/113709358 >> v1:172.21.15.81:6789/0 conn(0x7f368814db10 legacy=0x7f36880c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.503+0000 7f368ca05640 1 -- 172.21.15.38:0/113709358 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36881525b0 con 0x7f368814e420 2023-06-23T18:49:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368ca05640 1 --2- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814e420 0x7f368814e8a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c0480df0777720 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f3686ffd640 1 -- 172.21.15.38:0/113709358 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab600 con 0x7f368814e420 2023-06-23T18:49:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f3686ffd640 1 -- 172.21.15.38:0/113709358 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780a7050 con 0x7f368814e420 2023-06-23T18:49:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f3686ffd640 1 -- 172.21.15.38:0/113709358 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab980 con 0x7f368814e420 2023-06-23T18:49:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814e420 msgr2=0x7f368814e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 --2- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814e420 0x7f368814e8a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c480 comp rx=0 tx=0).stop 2023-06-23T18:49:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- 172.21.15.38:0/113709358 shutdown_connections 2023-06-23T18:49:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 --2- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814e420 0x7f368814e8a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 --2- 172.21.15.38:0/113709358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bc720 0x7f36880a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- 172.21.15.38:0/113709358 >> 172.21.15.38:0/113709358 conn(0x7f368806a0a0 msgr2=0x7f36880c0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- 172.21.15.38:0/113709358 shutdown_connections 2023-06-23T18:49:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- 172.21.15.38:0/113709358 wait complete. 2023-06-23T18:49:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 Processor -- start 2023-06-23T18:49:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.507+0000 7f368e468640 1 -- start start 2023-06-23T18:49:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 0x7f36880a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bbae0 0x7f3688144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880b9b70 con 0x7f368814e420 2023-06-23T18:49:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36881452a0 con 0x7f368814db10 2023-06-23T18:49:35.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880bb0a0 con 0x7f36880bbae0 2023-06-23T18:49:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56528/0 (socket says 172.21.15.38:56528) 2023-06-23T18:49:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 -- 172.21.15.38:0/666050155 learned_addr learned my addr 172.21.15.38:0/666050155 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368ca05640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bbae0 0x7f3688144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3687fff640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 0x7f36880a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 -- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bbae0 msgr2=0x7f3688144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bbae0 0x7f3688144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 -- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 msgr2=0x7f36880a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 0x7f36880a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 -- 172.21.15.38:0/666050155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009420 con 0x7f368814e420 2023-06-23T18:49:35.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3687fff640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 0x7f36880a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f36877fe640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f367000e930 tx=0x7f367000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670009690 con 0x7f368814e420 2023-06-23T18:49:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000ca00 con 0x7f368814e420 2023-06-23T18:49:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36880b97b0 con 0x7f368814e420 2023-06-23T18:49:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000cd70 con 0x7f368814e420 2023-06-23T18:49:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36880bb380 con 0x7f368814e420 2023-06-23T18:49:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368804d790 con 0x7f368814e420 2023-06-23T18:49:35.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3670013470 con 0x7f368814e420 2023-06-23T18:49:35.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 0x7f3668068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:35.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.511+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3670083da0 con 0x7f368814e420 2023-06-23T18:49:35.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.515+0000 7f3687fff640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 0x7f3668068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:35.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.515+0000 7f3687fff640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 0x7f3668068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3688070870 tx=0x7f3680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:35.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.519+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36700514c0 con 0x7f368814e420 2023-06-23T18:49:35.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:35.667+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f36880bb1e0 con 0x7f368814e420 2023-06-23T18:49:36.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.359+0000 7f3684ff9640 1 -- 172.21.15.38:0/666050155 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f36880bb1e0 con 0x7f368814e420 2023-06-23T18:49:36.368 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-06-23T18:49:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 msgr2=0x7f3668068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 0x7f3668068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3688070870 tx=0x7f3680009040 comp rx=0 tx=0).stop 2023-06-23T18:49:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 msgr2=0x7f3688144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f367000e930 tx=0x7f367000edf0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 shutdown_connections 2023-06-23T18:49:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3668066280 0x7f3668068730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f36880bbae0 0x7f3688144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f368814e420 0x7f3688144820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 --2- 172.21.15.38:0/666050155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368814db10 0x7f36880a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.371+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 >> 172.21.15.38:0/666050155 conn(0x7f36880bc720 msgr2=0x7f36880bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:36.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.383+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 shutdown_connections 2023-06-23T18:49:36.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.383+0000 7f368e468640 1 -- 172.21.15.38:0/666050155 wait complete. 2023-06-23T18:49:36.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T18:49:36.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 Processor -- start 2023-06-23T18:49:36.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 -- start start 2023-06-23T18:49:36.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc66406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640bcbe0 con 0x7fc6640a14b0 2023-06-23T18:49:36.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640baed0 con 0x7fc664069f50 2023-06-23T18:49:36.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc66b9f8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640bcf50 con 0x7fc664069550 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc669794640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc6640a14b0 0x7fc664156400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46950/0 (socket says 172.21.15.38:46950) 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc669794640 1 -- 172.21.15.38:0/4251262164 learned_addr learned my addr 172.21.15.38:0/4251262164 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc669f95640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc66406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216129821 0 0) 0x7fc6640bcbe0 con 0x7fc6640a14b0 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc650003530 con 0x7fc6640a14b0 2023-06-23T18:49:36.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678120831 0 0) 0x7fc650003530 con 0x7fc6640a14b0 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 msgr2=0x7fc66406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc66406a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 >> v1:172.21.15.81:6789/0 conn(0x7fc664069f50 legacy=0x7fc66414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640bb200 con 0x7fc6640a14b0 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fc65c001a00 con 0x7fc6640a14b0 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 >> v1:172.21.15.38:6789/0 conn(0x7fc6640a14b0 legacy=0x7fc664156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc6500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650004d10 0x7fc650005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640bcf50 con 0x7fc650003f30 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65000bb20 con 0x7fc650004d10 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65000bce0 con 0x7fc664069550 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc669794640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc6500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc669f95640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650004d10 0x7fc650005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 -- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 msgr2=0x7fc6500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc664069550 0x7fc6500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 -- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650004d10 msgr2=0x7fc650005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650004d10 0x7fc650005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.535+0000 7fc668f93640 1 -- 172.21.15.38:0/4251262164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc650003530 con 0x7fc650003f30 2023-06-23T18:49:36.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc668f93640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6500047d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6640bd150 tx=0x7fc65401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5081f80ec782ba84 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540052d0 con 0x7fc650003f30 2023-06-23T18:49:36.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6540a7050 con 0x7fc650003f30 2023-06-23T18:49:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc65bfff640 1 -- 172.21.15.38:0/4251262164 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654003600 con 0x7fc650003f30 2023-06-23T18:49:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- 172.21.15.38:0/4251262164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 msgr2=0x7fc6500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/4251262164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6500047d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6640bd150 tx=0x7fc65401c3a0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc669f95640 1 -- 172.21.15.38:0/4251262164 reap_dead start 2023-06-23T18:49:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- 172.21.15.38:0/4251262164 shutdown_connections 2023-06-23T18:49:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- 172.21.15.38:0/4251262164 >> 172.21.15.38:0/4251262164 conn(0x7fc6640bd180 msgr2=0x7fc6640bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:36.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- 172.21.15.38:0/4251262164 shutdown_connections 2023-06-23T18:49:36.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- 172.21.15.38:0/4251262164 wait complete. 2023-06-23T18:49:36.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 Processor -- start 2023-06-23T18:49:36.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.539+0000 7fc66b9f8640 1 -- start start 2023-06-23T18:49:36.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 0x7fc6640a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6640a4770 0x7fc66414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664146f80 con 0x7fc650003f30 2023-06-23T18:49:36.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641450d0 con 0x7fc664147a20 2023-06-23T18:49:36.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641ef5b0 con 0x7fc6640a4770 2023-06-23T18:49:36.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56542/0 (socket says 172.21.15.38:56542) 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 -- 172.21.15.38:0/3931386196 learned_addr learned my addr 172.21.15.38:0/3931386196 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669f95640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6640a4770 0x7fc66414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc668f93640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 0x7fc6640a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 -- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6640a4770 msgr2=0x7fc66414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6640a4770 0x7fc66414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 -- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 msgr2=0x7fc6640a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 0x7fc6640a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 -- 172.21.15.38:0/3931386196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6641ef890 con 0x7fc650003f30 2023-06-23T18:49:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc668f93640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 0x7fc6640a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc669794640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0078f0 tx=0x7fc65c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00ae90 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c0133f0 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0137a0 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641533b0 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66414e9e0 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6641efad0 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc65c013900 con 0x7fc650003f30 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.543+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc65c0849f0 con 0x7fc650003f30 2023-06-23T18:49:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.547+0000 7fc668f93640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.547+0000 7fc668f93640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc650004750 tx=0x7fc6540011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.551+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6641efad0 con 0x7fc650003f30 2023-06-23T18:49:36.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.735+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc6641efad0 con 0x7fc650003f30 2023-06-23T18:49:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.747+0000 7fc659ffb640 1 -- 172.21.15.38:0/3931386196 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc6641efad0 con 0x7fc650003f30 2023-06-23T18:49:36.756 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 3 and data pool 4 2023-06-23T18:49:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 msgr2=0x7fc648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc650004750 tx=0x7fc6540011a0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 msgr2=0x7fc6640a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0078f0 tx=0x7fc65c00a6e0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 shutdown_connections 2023-06-23T18:49:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6640a4770 0x7fc66414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc664147a20 0x7fc6640a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 --2- 172.21.15.38:0/3931386196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc650003f30 0x7fc6640a37b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 >> 172.21.15.38:0/3931386196 conn(0x7fc6640bd180 msgr2=0x7fc66414b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 shutdown_connections 2023-06-23T18:49:36.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.759+0000 7fc66b9f8640 1 -- 172.21.15.38:0/3931386196 wait complete. 2023-06-23T18:49:36.793 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-23T18:49:36.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-23T18:49:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 Processor -- start 2023-06-23T18:49:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 -- start start 2023-06-23T18:49:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa6014b930 0x7ffa6006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa600ba9d0 con 0x7ffa6006c9b0 2023-06-23T18:49:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa60071080 con 0x7ffa600bd1e0 2023-06-23T18:49:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa65b2d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600bc300 con 0x7ffa6014b930 2023-06-23T18:49:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa6014b930 0x7ffa6006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa6014b930 0x7ffa6006c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56552/0 (socket says 172.21.15.38:56552) 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 -- 172.21.15.38:0/3434657335 learned_addr learned my addr 172.21.15.38:0/3434657335 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5ffff640 1 --1- 172.21.15.38:0/3434657335 >> v1:172.21.15.38:6789/0 conn(0x7ffa6006c9b0 0x7ffa60070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46964/0 (socket says 172.21.15.38:46964) 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 -- 172.21.15.38:0/3434657335 >> v1:172.21.15.81:6789/0 conn(0x7ffa600bd1e0 legacy=0x7ffa60070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 -- 172.21.15.38:0/3434657335 >> v1:172.21.15.38:6789/0 conn(0x7ffa6006c9b0 legacy=0x7ffa60070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.907+0000 7ffa5f7fe640 1 -- 172.21.15.38:0/3434657335 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60150160 con 0x7ffa6014b930 2023-06-23T18:49:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5f7fe640 1 --2- 172.21.15.38:0/3434657335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6006c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa5001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5415fdd7900631 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5e7fc640 1 -- 172.21.15.38:0/3434657335 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500aa5f0 con 0x7ffa6014b930 2023-06-23T18:49:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5e7fc640 1 -- 172.21.15.38:0/3434657335 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa500aa750 con 0x7ffa6014b930 2023-06-23T18:49:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5e7fc640 1 -- 172.21.15.38:0/3434657335 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500aaae0 con 0x7ffa6014b930 2023-06-23T18:49:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/3434657335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 msgr2=0x7ffa6006c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/3434657335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6006c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa5001c470 comp rx=0 tx=0).stop 2023-06-23T18:49:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/3434657335 shutdown_connections 2023-06-23T18:49:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/3434657335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6006c470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/3434657335 >> 172.21.15.38:0/3434657335 conn(0x7ffa600c0c90 msgr2=0x7ffa600bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/3434657335 shutdown_connections 2023-06-23T18:49:36.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/3434657335 wait complete. 2023-06-23T18:49:36.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 Processor -- start 2023-06-23T18:49:36.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- start start 2023-06-23T18:49:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 0x7ffa60147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa600bd1e0 0x7ffa6013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600a5570 con 0x7ffa6014b930 2023-06-23T18:49:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60142ae0 con 0x7ffa6006c9b0 2023-06-23T18:49:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60147eb0 con 0x7ffa600bd1e0 2023-06-23T18:49:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56556/0 (socket says 172.21.15.38:56556) 2023-06-23T18:49:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 -- 172.21.15.38:0/1491050477 learned_addr learned my addr 172.21.15.38:0/1491050477 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5f7fe640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 0x7ffa60147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5effd640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa600bd1e0 0x7ffa6013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 -- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa600bd1e0 msgr2=0x7ffa6013f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa600bd1e0 0x7ffa6013f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 -- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 msgr2=0x7ffa60147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 0x7ffa60147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 -- 172.21.15.38:0/1491050477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500094d0 con 0x7ffa6014b930 2023-06-23T18:49:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5f7fe640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 0x7ffa60147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa5ffff640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c7d0 tx=0x7ffa5800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800a640 con 0x7ffa6014b930 2023-06-23T18:49:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800a7a0 con 0x7ffa6014b930 2023-06-23T18:49:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60142700 con 0x7ffa6014b930 2023-06-23T18:49:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800ab10 con 0x7ffa6014b930 2023-06-23T18:49:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.911+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6014f060 con 0x7ffa6014b930 2023-06-23T18:49:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60142c20 con 0x7ffa6014b930 2023-06-23T18:49:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa5800ac70 con 0x7ffa6014b930 2023-06-23T18:49:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa47fff640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 0x7ffa4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa58083400 con 0x7ffa6014b930 2023-06-23T18:49:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa5f7fe640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 0x7ffa4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.915+0000 7ffa5f7fe640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 0x7ffa4c068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa500ae000 tx=0x7ffa50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:36.919+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa60142c20 con 0x7ffa6014b930 2023-06-23T18:49:37.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.075+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7ffa60142c20 con 0x7ffa6014b930 2023-06-23T18:49:37.468 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-06-23T18:49:37.463+0000 7f819c00f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T18:49:37.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.759+0000 7ffa47fff640 1 -- 172.21.15.38:0/1491050477 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7ffa60142c20 con 0x7ffa6014b930 2023-06-23T18:49:37.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.763+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 msgr2=0x7ffa4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.763+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 0x7ffa4c068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa500ae000 tx=0x7ffa50008040 comp rx=0 tx=0).stop 2023-06-23T18:49:37.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.763+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 msgr2=0x7ffa6013f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.763+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800c7d0 tx=0x7ffa5800cc90 comp rx=0 tx=0).stop 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 shutdown_connections 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa4c0662b0 0x7ffa4c068760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6014b930 0x7ffa6013f700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa600bd1e0 0x7ffa6013f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 --2- 172.21.15.38:0/1491050477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa6006c9b0 0x7ffa60147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 >> 172.21.15.38:0/1491050477 conn(0x7ffa600c0c90 msgr2=0x7ffa600bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:37.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 shutdown_connections 2023-06-23T18:49:37.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.767+0000 7ffa65b2d640 1 -- 172.21.15.38:0/1491050477 wait complete. 2023-06-23T18:49:37.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T18:49:37.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.931+0000 7f24f78ee640 1 Processor -- start 2023-06-23T18:49:37.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.931+0000 7f24f78ee640 1 -- start start 2023-06-23T18:49:37.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f78ee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f006e830 0x7f24f014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f78ee640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24f014b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f78ee640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f006e1d0 con 0x7f24f006d620 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f78ee640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f00b8580 con 0x7f24f006e830 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f78ee640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0071060 con 0x7f24f006d9f0 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f24f006d620 0x7f24f0070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46968/0 (socket says 172.21.15.38:46968) 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 -- 172.21.15.38:0/1354546708 learned_addr learned my addr 172.21.15.38:0/1354546708 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:37.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f5e8b640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24f014b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f4e89640 1 --2- 172.21.15.38:0/1354546708 >> v2:172.21.15.81:3300/0 conn(0x7f24f006e830 0x7f24f014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002374675 0 0) 0x7f24f006e1d0 con 0x7f24f006d620 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24dc003530 con 0x7f24f006d620 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329797655 0 0) 0x7f24dc003530 con 0x7f24f006d620 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 msgr2=0x7f24f014b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24f014b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 >> v2:172.21.15.81:3300/0 conn(0x7f24f006e830 msgr2=0x7f24f014b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 --2- 172.21.15.38:0/1354546708 >> v2:172.21.15.81:3300/0 conn(0x7f24f006e830 0x7f24f014b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00b7c30 con 0x7f24f006d620 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f24ec001680 con 0x7f24f006d620 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 >> v1:172.21.15.38:6789/0 conn(0x7f24f006d620 legacy=0x7f24f0070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24dc003980 0x7f24dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc0047d0 0x7f24dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0071060 con 0x7f24dc003980 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc00b990 con 0x7f24dc0047d0 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc00bb50 con 0x7f24f006d9f0 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24dc003980 0x7f24dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f5e8b640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f4e89640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc0047d0 0x7f24dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 -- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 msgr2=0x7f24dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f006d9f0 0x7f24dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 -- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc0047d0 msgr2=0x7f24dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc0047d0 0x7f24dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.935+0000 7f24f568a640 1 -- 172.21.15.38:0/1354546708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc003530 con 0x7f24dc003980 2023-06-23T18:49:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f568a640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24dc003980 0x7f24dc003d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c290 tx=0x7f24ec01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3788c5390aa0feb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0058e0 con 0x7f24dc003980 2023-06-23T18:49:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec005a40 con 0x7f24dc003980 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24e7fff640 1 -- 172.21.15.38:0/1354546708 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec005df0 con 0x7f24dc003980 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- 172.21.15.38:0/1354546708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24dc003980 msgr2=0x7f24dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 --2- 172.21.15.38:0/1354546708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24dc003980 0x7f24dc003d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c290 tx=0x7f24ec01ccb0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f5e8b640 1 -- 172.21.15.38:0/1354546708 reap_dead start 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- 172.21.15.38:0/1354546708 shutdown_connections 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- 172.21.15.38:0/1354546708 >> 172.21.15.38:0/1354546708 conn(0x7f24f00c1fc0 msgr2=0x7f24f00c23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- 172.21.15.38:0/1354546708 shutdown_connections 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- 172.21.15.38:0/1354546708 wait complete. 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 Processor -- start 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- start start 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc003980 0x7f24f013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f01e7760 0x7f24f014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f014e3d0 con 0x7f24f01478b0 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01e7be0 con 0x7f24dc003980 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f78ee640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0154020 con 0x7f24f01e7760 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f4e89640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f4e89640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56574/0 (socket says 172.21.15.38:56574) 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f4e89640 1 -- 172.21.15.38:0/3038481163 learned_addr learned my addr 172.21.15.38:0/3038481163 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f568a640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc003980 0x7f24f013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.939+0000 7f24f5e8b640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f01e7760 0x7f24f014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 -- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f01e7760 msgr2=0x7f24f014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f01e7760 0x7f24f014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 -- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc003980 msgr2=0x7f24f013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc003980 0x7f24f013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 -- 172.21.15.38:0/3038481163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f01400a0 con 0x7f24f01478b0 2023-06-23T18:49:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f4e89640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24e00115d0 tx=0x7f24e0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0015870 con 0x7f24f01478b0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e00159d0 con 0x7f24f01478b0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f01e6d00 con 0x7f24f01478b0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0015d80 con 0x7f24f01478b0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f0144510 con 0x7f24f01478b0 2023-06-23T18:49:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f004d790 con 0x7f24f01478b0 2023-06-23T18:49:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24e000f480 con 0x7f24f01478b0 2023-06-23T18:49:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 0x7f24d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:37.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f24e0084440 con 0x7f24f01478b0 2023-06-23T18:49:37.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f568a640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 0x7f24d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:37.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.943+0000 7f24f568a640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 0x7f24d4068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0aa000 tx=0x7f24ec001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:37.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:37.947+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24e00518a0 con 0x7f24f01478b0 2023-06-23T18:49:38.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:38.107+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f24f01e6e90 con 0x7f24f01478b0 2023-06-23T18:49:39.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.779+0000 7f24e5ffb640 1 -- 172.21.15.38:0/3038481163 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f24e0054ec0 con 0x7f24f01478b0 2023-06-23T18:49:39.786 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data_ec' created 2023-06-23T18:49:39.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 msgr2=0x7f24d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 0x7f24d4068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0aa000 tx=0x7f24ec001a10 comp rx=0 tx=0).stop 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 msgr2=0x7f24f01e7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24e00115d0 tx=0x7f24e0011a90 comp rx=0 tx=0).stop 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 shutdown_connections 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f24d40662b0 0x7f24d4068760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f24f01e7760 0x7f24f014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24f01478b0 0x7f24f01e7220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 --2- 172.21.15.38:0/3038481163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24dc003980 0x7f24f013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 >> 172.21.15.38:0/3038481163 conn(0x7f24f00c1fc0 msgr2=0x7f24f0140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:39.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 shutdown_connections 2023-06-23T18:49:39.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.787+0000 7f24f78ee640 1 -- 172.21.15.38:0/3038481163 wait complete. 2023-06-23T18:49:39.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-23T18:49:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 Processor -- start 2023-06-23T18:49:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 -- start start 2023-06-23T18:49:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2fc14b930 0x7fc2fc06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0ba9d0 con 0x7fc2fc0bd1e0 2023-06-23T18:49:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0bc300 con 0x7fc2fc14b930 2023-06-23T18:49:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc302353640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0a5570 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc2fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2fc14b930 0x7fc2fc06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:39050/0 (socket says 172.21.15.38:39050) 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 -- 172.21.15.38:0/521511282 learned_addr learned my addr 172.21.15.38:0/521511282 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 -- 172.21.15.38:0/521511282 >> v2:172.21.15.81:3300/0 conn(0x7fc2fc14b930 msgr2=0x7fc2fc06c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 --2- 172.21.15.38:0/521511282 >> v2:172.21.15.81:3300/0 conn(0x7fc2fc14b930 0x7fc2fc06c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 -- 172.21.15.38:0/521511282 >> v1:172.21.15.81:6789/0 conn(0x7fc2fc0bd1e0 legacy=0x7fc2fc070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.943+0000 7fc3008f0640 1 -- 172.21.15.38:0/521511282 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc150160 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc3008f0640 1 --2- 172.21.15.38:0/521511282 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009870 tx=0x7fc2f401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b92f2980a9e1cd6f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc2faffd640 1 -- 172.21.15.38:0/521511282 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40aa430 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc2faffd640 1 -- 172.21.15.38:0/521511282 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f40aa590 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc2faffd640 1 -- 172.21.15.38:0/521511282 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40aa920 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 -- 172.21.15.38:0/521511282 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 msgr2=0x7fc2fc070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 --2- 172.21.15.38:0/521511282 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009870 tx=0x7fc2f401c4b0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 -- 172.21.15.38:0/521511282 shutdown_connections 2023-06-23T18:49:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 --2- 172.21.15.38:0/521511282 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc06c9b0 0x7fc2fc070970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 --2- 172.21.15.38:0/521511282 >> v2:172.21.15.81:3300/0 conn(0x7fc2fc14b930 0x7fc2fc06c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 -- 172.21.15.38:0/521511282 >> 172.21.15.38:0/521511282 conn(0x7fc2fc0c0c90 msgr2=0x7fc2fc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 -- 172.21.15.38:0/521511282 shutdown_connections 2023-06-23T18:49:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.947+0000 7fc302353640 1 -- 172.21.15.38:0/521511282 wait complete. 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 Processor -- start 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- start start 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2fc0bd1e0 0x7fc2fc14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc14b930 0x7fc2fc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0b91d0 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc14a710 con 0x7fc2fc0bd1e0 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0b7340 con 0x7fc2fc14b930 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56582/0 (socket says 172.21.15.38:56582) 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 -- 172.21.15.38:0/1043522920 learned_addr learned my addr 172.21.15.38:0/1043522920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fb7fe640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2fc0bd1e0 0x7fc2fc14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc3008f0640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc14b930 0x7fc2fc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 -- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc14b930 msgr2=0x7fc2fc0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc14b930 0x7fc2fc0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 -- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2fc0bd1e0 msgr2=0x7fc2fc14a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2fc0bd1e0 0x7fc2fc14a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 -- 172.21.15.38:0/1043522920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40094d0 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2fbfff640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00efc0 tx=0x7fc2ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec009b80 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec00f040 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc0b8e60 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0146a0 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc0b6ba0 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc0b6e20 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2ec014800 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.951+0000 7fc2f8ff9640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 0x7fc2dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.955+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fc2ec085230 con 0x7fc2fc06c9b0 2023-06-23T18:49:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.955+0000 7fc2fb7fe640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 0x7fc2dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:39.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.955+0000 7fc2fb7fe640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 0x7fc2dc068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc1e51a0 tx=0x7fc2e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:39.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:39.955+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2ec055f10 con 0x7fc2fc06c9b0 2023-06-23T18:49:40.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.111+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc2fc04d790 con 0x7fc2fc06c9b0 2023-06-23T18:49:40.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.787+0000 7fc2f8ff9640 1 -- 172.21.15.38:0/1043522920 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc2ec055aa0 con 0x7fc2fc06c9b0 2023-06-23T18:49:40.799 INFO:teuthology.orchestra.run.smithi038.stderr:set pool 5 allow_ec_overwrites to true 2023-06-23T18:49:40.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.803+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 msgr2=0x7fc2dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.803+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 0x7fc2dc068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc1e51a0 tx=0x7fc2e4009040 comp rx=0 tx=0).stop 2023-06-23T18:49:40.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.803+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 msgr2=0x7fc2fc145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.803+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00efc0 tx=0x7fc2ec00c490 comp rx=0 tx=0).stop 2023-06-23T18:49:40.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 shutdown_connections 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2dc066280 0x7fc2dc068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2fc14b930 0x7fc2fc0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2fc0bd1e0 0x7fc2fc14a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 --2- 172.21.15.38:0/1043522920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2fc06c9b0 0x7fc2fc145540 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 >> 172.21.15.38:0/1043522920 conn(0x7fc2fc0c0c90 msgr2=0x7fc2fc14f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:40.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 shutdown_connections 2023-06-23T18:49:40.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.807+0000 7fc302353640 1 -- 172.21.15.38:0/1043522920 wait complete. 2023-06-23T18:49:40.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-23T18:49:40.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 Processor -- start 2023-06-23T18:49:40.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 -- start start 2023-06-23T18:49:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09140702a0 0x7f0914070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f091406e5e0 0x7f091406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140713f0 con 0x7f0914137260 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0914152150 con 0x7f091406e5e0 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0918e88640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914152430 con 0x7f09140702a0 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f091406e5e0 0x7f091406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f091406e5e0 0x7f091406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56586/0 (socket says 172.21.15.38:56586) 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 -- 172.21.15.38:0/790109991 learned_addr learned my addr 172.21.15.38:0/790109991 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0911d9b640 1 --1- 172.21.15.38:0/790109991 >> v1:172.21.15.38:6789/0 conn(0x7f0914137260 0x7f0914133950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46984/0 (socket says 172.21.15.38:46984) 2023-06-23T18:49:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f091259c640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09140702a0 0x7f0914070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 -- 172.21.15.38:0/790109991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09140702a0 msgr2=0x7f0914070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09140702a0 0x7f0914070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 -- 172.21.15.38:0/790109991 >> v1:172.21.15.38:6789/0 conn(0x7f0914137260 legacy=0x7f0914133950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.963+0000 7f0912d9d640 1 -- 172.21.15.38:0/790109991 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914136f80 con 0x7f091406e5e0 2023-06-23T18:49:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0912d9d640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f091406a580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447f8fc493726929 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091159a640 1 -- 172.21.15.38:0/790109991 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab600 con 0x7f091406e5e0 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091159a640 1 -- 172.21.15.38:0/790109991 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0a7050 con 0x7f091406e5e0 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091159a640 1 -- 172.21.15.38:0/790109991 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab980 con 0x7f091406e5e0 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/790109991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 msgr2=0x7f091406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f091406a580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c01c420 comp rx=0 tx=0).stop 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/790109991 shutdown_connections 2023-06-23T18:49:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f091406a580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- 172.21.15.38:0/790109991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09140702a0 0x7f0914070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/790109991 >> 172.21.15.38:0/790109991 conn(0x7f09140c1fe0 msgr2=0x7f09140c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/790109991 shutdown_connections 2023-06-23T18:49:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/790109991 wait complete. 2023-06-23T18:49:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 Processor -- start 2023-06-23T18:49:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- start start 2023-06-23T18:49:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 0x7f0914132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0914137260 0x7f09140be110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091414d5f0 con 0x7f091406e5e0 2023-06-23T18:49:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140bd6f0 con 0x7f09140702a0 2023-06-23T18:49:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140bdb40 con 0x7f0914137260 2023-06-23T18:49:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56590/0 (socket says 172.21.15.38:56590) 2023-06-23T18:49:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 -- 172.21.15.38:0/3309365067 learned_addr learned my addr 172.21.15.38:0/3309365067 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0912d9d640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0914137260 0x7f09140be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0911d9b640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 0x7f0914132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 -- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0914137260 msgr2=0x7f09140be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0914137260 0x7f09140be110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 -- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 msgr2=0x7f0914132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 0x7f0914132e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 -- 172.21.15.38:0/3309365067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0094d0 con 0x7f091406e5e0 2023-06-23T18:49:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0911d9b640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 0x7f0914132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f091259c640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0904007f20 tx=0x7f090400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904014620 con 0x7f091406e5e0 2023-06-23T18:49:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904014780 con 0x7f091406e5e0 2023-06-23T18:49:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904014b30 con 0x7f091406e5e0 2023-06-23T18:49:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914133350 con 0x7f091406e5e0 2023-06-23T18:49:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.967+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09140be650 con 0x7f091406e5e0 2023-06-23T18:49:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091404d790 con 0x7f091406e5e0 2023-06-23T18:49:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0904014c90 con 0x7f091406e5e0 2023-06-23T18:49:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0902ffd640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 0x7f08f4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f0904084a30 con 0x7f091406e5e0 2023-06-23T18:49:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0911d9b640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 0x7f08f4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.971+0000 7f0911d9b640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 0x7f08f4068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09140bcf90 tx=0x7f0908009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:40.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:40.975+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0904051bd0 con 0x7f091406e5e0 2023-06-23T18:49:41.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.163+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f09140c0fe0 con 0x7f091406e5e0 2023-06-23T18:49:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0902ffd640 1 -- 172.21.15.38:0/3309365067 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f09040551f0 con 0x7f091406e5e0 2023-06-23T18:49:41.177 INFO:teuthology.orchestra.run.smithi038.stderr:added data pool 5 to fsmap 2023-06-23T18:49:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 msgr2=0x7f08f4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 0x7f08f4068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09140bcf90 tx=0x7f0908009040 comp rx=0 tx=0).stop 2023-06-23T18:49:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 msgr2=0x7f09141e9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0904007f20 tx=0x7f090400e570 comp rx=0 tx=0).stop 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 shutdown_connections 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f08f40662b0 0x7f08f4068760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0914137260 0x7f09140be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09140702a0 0x7f0914132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 --2- 172.21.15.38:0/3309365067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f091406e5e0 0x7f09141e9ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 >> 172.21.15.38:0/3309365067 conn(0x7f09140c1fe0 msgr2=0x7f09140c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 shutdown_connections 2023-06-23T18:49:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.171+0000 7f0918e88640 1 -- 172.21.15.38:0/3309365067 wait complete. 2023-06-23T18:49:41.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:49:41.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 Processor -- start 2023-06-23T18:49:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 -- start start 2023-06-23T18:49:41.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffbc014c8f0 0x7ffbc00b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc00b6c40 con 0x7ffbc014f570 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc00b5c30 con 0x7ffbc00a3960 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbc5089640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc00b6190 con 0x7ffbc014c8f0 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffbc014f570 0x7ffbc014f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46998/0 (socket says 172.21.15.38:46998) 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbed9d640 1 -- 172.21.15.38:0/2478419112 learned_addr learned my addr 172.21.15.38:0/2478419112 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbf59e640 1 --2- 172.21.15.38:0/2478419112 >> v2:172.21.15.38:3300/0 conn(0x7ffbc014c8f0 0x7ffbc00b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbdd9b640 1 -- 172.21.15.38:0/2478419112 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272516407 0 0) 0x7ffbc00b6c40 con 0x7ffbc014f570 2023-06-23T18:49:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbdd9b640 1 -- 172.21.15.38:0/2478419112 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba8003530 con 0x7ffbc014f570 2023-06-23T18:49:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbf59e640 1 -- 172.21.15.38:0/2478419112 >> v1:172.21.15.81:6789/0 conn(0x7ffbc00a3960 legacy=0x7ffbc014c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbf59e640 1 -- 172.21.15.38:0/2478419112 >> v1:172.21.15.38:6789/0 conn(0x7ffbc014f570 legacy=0x7ffbc014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.299+0000 7ffbbf59e640 1 -- 172.21.15.38:0/2478419112 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00b6960 con 0x7ffbc014c8f0 2023-06-23T18:49:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbf59e640 1 --2- 172.21.15.38:0/2478419112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc014c8f0 0x7ffbc00b6eb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00097c0 tx=0x7ffbb001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68c4a774eac199b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbdd9b640 1 -- 172.21.15.38:0/2478419112 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004230 con 0x7ffbc014c8f0 2023-06-23T18:49:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbdd9b640 1 -- 172.21.15.38:0/2478419112 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb00a7050 con 0x7ffbc014c8f0 2023-06-23T18:49:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbdd9b640 1 -- 172.21.15.38:0/2478419112 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0003620 con 0x7ffbc014c8f0 2023-06-23T18:49:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/2478419112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc014c8f0 msgr2=0x7ffbc00b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 --2- 172.21.15.38:0/2478419112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc014c8f0 0x7ffbc00b6eb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00097c0 tx=0x7ffbb001c330 comp rx=0 tx=0).stop 2023-06-23T18:49:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/2478419112 shutdown_connections 2023-06-23T18:49:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 --2- 172.21.15.38:0/2478419112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc014c8f0 0x7ffbc00b6eb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/2478419112 >> 172.21.15.38:0/2478419112 conn(0x7ffbc00bd120 msgr2=0x7ffbc00bd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/2478419112 shutdown_connections 2023-06-23T18:49:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/2478419112 wait complete. 2023-06-23T18:49:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 Processor -- start 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- start start 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbc014c8f0 0x7ffbc0149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 0x7ffbc014c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01e9ea0 con 0x7ffbc00a3960 2023-06-23T18:49:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc014d1f0 con 0x7ffbc014f570 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc014d4d0 con 0x7ffbc014c8f0 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56604/0 (socket says 172.21.15.38:56604) 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 -- 172.21.15.38:0/216970840 learned_addr learned my addr 172.21.15.38:0/216970840 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbf59e640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 0x7ffbc014c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 -- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbc014c8f0 msgr2=0x7ffbc0149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbe59c640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbc014c8f0 0x7ffbc0149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbc014c8f0 0x7ffbc0149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 -- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 msgr2=0x7ffbc014c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 0x7ffbc014c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 -- 172.21.15.38:0/216970840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009420 con 0x7ffbc00a3960 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbf59e640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 0x7ffbc014c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbbed9d640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800cbf0 tx=0x7ffbb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800ad50 con 0x7ffbc00a3960 2023-06-23T18:49:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8012400 con 0x7ffbc00a3960 2023-06-23T18:49:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8012790 con 0x7ffbc00a3960 2023-06-23T18:49:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.303+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc0149aa0 con 0x7ffbc00a3960 2023-06-23T18:49:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc014d8e0 con 0x7ffbc00a3960 2023-06-23T18:49:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc014d740 con 0x7ffbc00a3960 2023-06-23T18:49:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbb8007070 con 0x7ffbc00a3960 2023-06-23T18:49:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffba77fe640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffbb8084070 con 0x7ffbc00a3960 2023-06-23T18:49:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffbbe59c640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.307+0000 7ffbbe59c640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 0x7ffbac068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffbc014c860 tx=0x7ffbb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.311+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbc014d740 con 0x7ffbc00a3960 2023-06-23T18:49:41.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.495+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbc014d740 con 0x7ffbc00a3960 2023-06-23T18:49:41.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffba77fe640 1 -- 172.21.15.38:0/216970840 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3155 (secure 0 0 0) 0x7ffbc014d740 con 0x7ffbc00a3960 2023-06-23T18:49:41.505 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:41.505 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:41.169506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-23T18:49:41.505 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2023-06-23T18:49:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 msgr2=0x7ffbac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 0x7ffbac068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffbc014c860 tx=0x7ffbb4009040 comp rx=0 tx=0).stop 2023-06-23T18:49:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 msgr2=0x7ffbc01e9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800cbf0 tx=0x7ffbb800a430 comp rx=0 tx=0).stop 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 shutdown_connections 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc014f570 0x7ffbc014c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbc014c8f0 0x7ffbc0149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 --2- 172.21.15.38:0/216970840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbc00a3960 0x7ffbc01e9960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 >> 172.21.15.38:0/216970840 conn(0x7ffbc00bd120 msgr2=0x7ffbc006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 shutdown_connections 2023-06-23T18:49:41.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.499+0000 7ffbc5089640 1 -- 172.21.15.38:0/216970840 wait complete. 2023-06-23T18:49:41.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:41.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 Processor -- start 2023-06-23T18:49:41.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 -- start start 2023-06-23T18:49:41.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6c814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c814cc30 con 0x7fa6c806e580 2023-06-23T18:49:41.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c80bd220 con 0x7fa6c80bca30 2023-06-23T18:49:41.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6cdd50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c806dd70 con 0x7fa6c814b630 2023-06-23T18:49:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa6c806e580 0x7fa6c806fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47008/0 (socket says 172.21.15.38:47008) 2023-06-23T18:49:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c7fff640 1 -- 172.21.15.38:0/3230450 learned_addr learned my addr 172.21.15.38:0/3230450 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6c814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963929863 0 0) 0x7fa6c814cc30 con 0x7fa6c806e580 2023-06-23T18:49:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b4003530 con 0x7fa6c806e580 2023-06-23T18:49:41.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225699292 0 0) 0x7fa6b4003530 con 0x7fa6c806e580 2023-06-23T18:49:41.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 msgr2=0x7fa6c814c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6c814c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 >> v1:172.21.15.81:6789/0 conn(0x7fa6c80bca30 legacy=0x7fa6c806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c806da60 con 0x7fa6c806e580 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fa6c0001680 con 0x7fa6c806e580 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 >> v1:172.21.15.38:6789/0 conn(0x7fa6c806e580 legacy=0x7fa6c806fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6b40039b0 0x7fa6b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40047d0 0x7fa6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6b40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c806dd70 con 0x7fa6b40039b0 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400ba90 con 0x7fa6b40047d0 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b400bc50 con 0x7fa6c814b630 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6b40039b0 0x7fa6b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c6ffd640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40047d0 0x7fa6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c7fff640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6b40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 -- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 msgr2=0x7fa6b40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6c814b630 0x7fa6b40051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 -- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40047d0 msgr2=0x7fa6b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6b40047d0 0x7fa6b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.639+0000 7fa6c77fe640 1 -- 172.21.15.38:0/3230450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4003530 con 0x7fa6b40039b0 2023-06-23T18:49:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6b40039b0 0x7fa6b4003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009fc0 tx=0x7fa6b801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b103dbe824aa191 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80a5b60 con 0x7fa6b40039b0 2023-06-23T18:49:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b800f040 con 0x7fa6b40039b0 2023-06-23T18:49:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6c67fc640 1 -- 172.21.15.38:0/3230450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80ad440 con 0x7fa6b40039b0 2023-06-23T18:49:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3230450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6b40039b0 msgr2=0x7fa6b4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3230450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6b40039b0 0x7fa6b4003dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009fc0 tx=0x7fa6b801cc60 comp rx=0 tx=0).stop 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6c7fff640 1 -- 172.21.15.38:0/3230450 reap_dead start 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3230450 shutdown_connections 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3230450 >> 172.21.15.38:0/3230450 conn(0x7fa6c80c1fb0 msgr2=0x7fa6c80c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3230450 shutdown_connections 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3230450 wait complete. 2023-06-23T18:49:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 Processor -- start 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- start start 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 0x7fa6c814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 0x7fa6c81e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c81e7040 con 0x7fa6c814fc80 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c813d640 con 0x7fa6c81e6660 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.643+0000 7fa6cdd50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8147490 con 0x7fa6b40039b0 2023-06-23T18:49:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56616/0 (socket says 172.21.15.38:56616) 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 -- 172.21.15.38:0/3033614969 learned_addr learned my addr 172.21.15.38:0/3033614969 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 0x7fa6c814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c7fff640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 0x7fa6c81e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 -- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 msgr2=0x7fa6c814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 0x7fa6c814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 -- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 msgr2=0x7fa6c81e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 0x7fa6c81e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 -- 172.21.15.38:0/3033614969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c81ea170 con 0x7fa6c814fc80 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 0x7fa6c814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c7fff640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 0x7fa6c81e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c6ffd640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000e5b0 tx=0x7fa6b000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00052e0 con 0x7fa6c814fc80 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0005440 con 0x7fa6c814fc80 2023-06-23T18:49:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c81e6140 con 0x7fa6c814fc80 2023-06-23T18:49:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0003820 con 0x7fa6c814fc80 2023-06-23T18:49:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c81e9db0 con 0x7fa6c814fc80 2023-06-23T18:49:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c81e9fd0 con 0x7fa6c814fc80 2023-06-23T18:49:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6b0003980 con 0x7fa6c814fc80 2023-06-23T18:49:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 0x7fa6a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6b0083e00 con 0x7fa6c814fc80 2023-06-23T18:49:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 0x7fa6a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.647+0000 7fa6c77fe640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 0x7fa6a8068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80af000 tx=0x7fa6b80a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.651+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6c81e9fd0 con 0x7fa6c814fc80 2023-06-23T18:49:41.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.807+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6c81e9fd0 con 0x7fa6c814fc80 2023-06-23T18:49:41.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6bffff640 1 -- 172.21.15.38:0/3033614969 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fa6c81e9fd0 con 0x7fa6c814fc80 2023-06-23T18:49:41.818 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:41.818 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 msgr2=0x7fa6a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 0x7fa6a8068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80af000 tx=0x7fa6b80a7040 comp rx=0 tx=0).stop 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 msgr2=0x7fa6c8146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000e5b0 tx=0x7fa6b000ea70 comp rx=0 tx=0).stop 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 shutdown_connections 2023-06-23T18:49:41.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa6a8066280 0x7fa6a8068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c81e6660 0x7fa6c81e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6c814fc80 0x7fa6c8146f50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 --2- 172.21.15.38:0/3033614969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6b40039b0 0x7fa6c814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 >> 172.21.15.38:0/3033614969 conn(0x7fa6c80c1fb0 msgr2=0x7fa6c8156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 shutdown_connections 2023-06-23T18:49:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.811+0000 7fa6cdd50640 1 -- 172.21.15.38:0/3033614969 wait complete. 2023-06-23T18:49:41.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:41.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.955+0000 7fcf9703f640 1 Processor -- start 2023-06-23T18:49:41.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.955+0000 7fcf9703f640 1 -- start start 2023-06-23T18:49:41.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf9703f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf90069470 0x7fcf90151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf9703f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9014f150 con 0x7fcf900bafe0 2023-06-23T18:49:41.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf9703f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900b5f10 con 0x7fcf9014e5d0 2023-06-23T18:49:41.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf9703f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900bd070 con 0x7fcf90069470 2023-06-23T18:49:41.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf94ddb640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcf900bafe0 0x7fcf901518d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47010/0 (socket says 172.21.15.38:47010) 2023-06-23T18:49:41.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf94ddb640 1 -- 172.21.15.38:0/4233122900 learned_addr learned my addr 172.21.15.38:0/4233122900 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:41.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/4233122900 >> v2:172.21.15.81:3300/0 conn(0x7fcf90069470 0x7fcf90151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043399774 0 0) 0x7fcf9014f150 con 0x7fcf900bafe0 2023-06-23T18:49:41.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf78003530 con 0x7fcf900bafe0 2023-06-23T18:49:41.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3428468135 0 0) 0x7fcf78003530 con 0x7fcf900bafe0 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 >> v2:172.21.15.81:3300/0 conn(0x7fcf90069470 msgr2=0x7fcf90151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 --2- 172.21.15.38:0/4233122900 >> v2:172.21.15.81:3300/0 conn(0x7fcf90069470 0x7fcf90151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 >> v1:172.21.15.81:6789/0 conn(0x7fcf9014e5d0 legacy=0x7fcf901588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900b6f90 con 0x7fcf900bafe0 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fcf80001680 con 0x7fcf900bafe0 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 >> v1:172.21.15.38:6789/0 conn(0x7fcf900bafe0 legacy=0x7fcf901518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf78003980 0x7fcf78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf780047d0 0x7fcf78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900bd070 con 0x7fcf78005180 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7800c000 con 0x7fcf780047d0 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7800c1c0 con 0x7fcf78003980 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf780047d0 0x7fcf78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf94ddb640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf78003980 0x7fcf78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 -- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf78003980 msgr2=0x7fcf78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf78003980 0x7fcf78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 -- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf780047d0 msgr2=0x7fcf78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf780047d0 0x7fcf78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 -- 172.21.15.38:0/4233122900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78003530 con 0x7fcf78005180 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf780047d0 0x7fcf78004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf94ddb640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf78003980 0x7fcf78003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 -- 172.21.15.38:0/4233122900 reap_dead start 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf955dc640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf7800b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf88001e70 tx=0x7fcf8801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b734017891cbdf71 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88003b80 con 0x7fcf78005180 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf88003d00 con 0x7fcf78005180 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.959+0000 7fcf8f7fe640 1 -- 172.21.15.38:0/4233122900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88005260 con 0x7fcf78005180 2023-06-23T18:49:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 msgr2=0x7fcf7800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf7800b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf88001e70 tx=0x7fcf8801c760 comp rx=0 tx=0).stop 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/4233122900 shutdown_connections 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 --2- 172.21.15.38:0/4233122900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf7800b990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/4233122900 >> 172.21.15.38:0/4233122900 conn(0x7fcf900bd1b0 msgr2=0x7fcf900bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/4233122900 shutdown_connections 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/4233122900 wait complete. 2023-06-23T18:49:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 Processor -- start 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- start start 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 0x7fcf9014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 0x7fcf900b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900a2f10 con 0x7fcf78005180 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b8f60 con 0x7fcf901d91c0 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900a5af0 con 0x7fcf9014d4f0 2023-06-23T18:49:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56636/0 (socket says 172.21.15.38:56636) 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 -- 172.21.15.38:0/3031374147 learned_addr learned my addr 172.21.15.38:0/3031374147 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 0x7fcf9014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf955dc640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 0x7fcf900b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 -- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 msgr2=0x7fcf9014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 0x7fcf9014c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 -- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 msgr2=0x7fcf900b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 0x7fcf900b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 -- 172.21.15.38:0/3031374147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900b7800 con 0x7fcf78005180 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 0x7fcf9014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf955dc640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 0x7fcf900b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf94ddb640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000d770 tx=0x7fcf8000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800074e0 con 0x7fcf78005180 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80007640 con 0x7fcf78005180 2023-06-23T18:49:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900a51c0 con 0x7fcf78005180 2023-06-23T18:49:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800049f0 con 0x7fcf78005180 2023-06-23T18:49:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.963+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf900a5780 con 0x7fcf78005180 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9004d790 con 0x7fcf78005180 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf80004b50 con 0x7fcf78005180 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf8d7fa640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf80083820 con 0x7fcf78005180 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.967+0000 7fcf8ffff640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 0x7fcf7c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009a20 tx=0x7fcf84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:41.971+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf80050a60 con 0x7fcf78005180 2023-06-23T18:49:42.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.123+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf90071620 con 0x7fcf78005180 2023-06-23T18:49:42.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf8d7fa640 1 -- 172.21.15.38:0/3031374147 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fcf80054080 con 0x7fcf78005180 2023-06-23T18:49:42.134 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:42.134 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:42.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 msgr2=0x7fcf7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 0x7fcf7c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009a20 tx=0x7fcf84008040 comp rx=0 tx=0).stop 2023-06-23T18:49:42.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 msgr2=0x7fcf901d8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000d770 tx=0x7fcf8000dc30 comp rx=0 tx=0).stop 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 shutdown_connections 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf901d91c0 0x7fcf900b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf9014d4f0 0x7fcf9014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 --2- 172.21.15.38:0/3031374147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf78005180 0x7fcf901d8c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 >> 172.21.15.38:0/3031374147 conn(0x7fcf900bd1b0 msgr2=0x7fcf900bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:42.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 shutdown_connections 2023-06-23T18:49:42.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.127+0000 7fcf9703f640 1 -- 172.21.15.38:0/3031374147 wait complete. 2023-06-23T18:49:42.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:49:42.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 Processor -- start 2023-06-23T18:49:42.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 -- start start 2023-06-23T18:49:42.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9b814b930 0x7fa9b806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa9b80bd1e0 0x7fa9b8070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b80ba9d0 con 0x7fa9b806c9b0 2023-06-23T18:49:42.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80bc300 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9be519640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80a5570 con 0x7fa9b814b930 2023-06-23T18:49:42.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa9b80bd1e0 0x7fa9b8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9bcab6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa9b806c9b0 0x7fa9b80707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47016/0 (socket says 172.21.15.38:47016) 2023-06-23T18:49:42.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa9b80bd1e0 0x7fa9b8070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56648/0 (socket says 172.21.15.38:56648) 2023-06-23T18:49:42.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9bcab6640 1 -- 172.21.15.38:0/520448052 learned_addr learned my addr 172.21.15.38:0/520448052 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:42.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9b7fff640 1 --2- 172.21.15.38:0/520448052 >> v2:172.21.15.81:3300/0 conn(0x7fa9b814b930 0x7fa9b806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 -- 172.21.15.38:0/520448052 >> v2:172.21.15.81:3300/0 conn(0x7fa9b814b930 msgr2=0x7fa9b806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:42.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 --2- 172.21.15.38:0/520448052 >> v2:172.21.15.81:3300/0 conn(0x7fa9b814b930 0x7fa9b806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 -- 172.21.15.38:0/520448052 >> v1:172.21.15.38:6789/0 conn(0x7fa9b806c9b0 legacy=0x7fa9b80707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9affff640 1 -- 172.21.15.38:0/520448052 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8150160 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.279+0000 7fa9b77fe640 1 -- 172.21.15.38:0/520448052 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666132975 0 0) 0x7fa9b80ba9d0 con 0x7fa9b806c9b0 2023-06-23T18:49:42.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9affff640 1 --2- 172.21.15.38:0/520448052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b80bd1e0 0x7fa9b8070260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80679f0 tx=0x7fa9a001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f084fdff95cc39 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9b77fe640 1 -- 172.21.15.38:0/520448052 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00ab5f0 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9b77fe640 1 -- 172.21.15.38:0/520448052 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00ab750 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9b77fe640 1 -- 172.21.15.38:0/520448052 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00abae0 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- 172.21.15.38:0/520448052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b80bd1e0 msgr2=0x7fa9b8070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 --2- 172.21.15.38:0/520448052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b80bd1e0 0x7fa9b8070260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80679f0 tx=0x7fa9a001c3d0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- 172.21.15.38:0/520448052 shutdown_connections 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 --2- 172.21.15.38:0/520448052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b80bd1e0 0x7fa9b8070260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 --2- 172.21.15.38:0/520448052 >> v2:172.21.15.81:3300/0 conn(0x7fa9b814b930 0x7fa9b806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- 172.21.15.38:0/520448052 >> 172.21.15.38:0/520448052 conn(0x7fa9b80c0c90 msgr2=0x7fa9b80bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- 172.21.15.38:0/520448052 shutdown_connections 2023-06-23T18:49:42.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- 172.21.15.38:0/520448052 wait complete. 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 Processor -- start 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 -- start start 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.283+0000 7fa9be519640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 0x7fa9b81e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b814b930 0x7fa9b81e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8149630 con 0x7fa9b806c9b0 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b814aa80 con 0x7fa9b814b930 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b806eb20 con 0x7fa9b80bd1e0 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56652/0 (socket says 172.21.15.38:56652) 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 -- 172.21.15.38:0/445156817 learned_addr learned my addr 172.21.15.38:0/445156817 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9affff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 0x7fa9b81e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9bcab6640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b814b930 0x7fa9b81e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 -- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 msgr2=0x7fa9b81e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 0x7fa9b81e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 -- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b814b930 msgr2=0x7fa9b81e9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b814b930 0x7fa9b81e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 -- 172.21.15.38:0/445156817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009420 con 0x7fa9b806c9b0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9affff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 0x7fa9b81e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b7fff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d5f0 tx=0x7fa9a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80125f0 con 0x7fa9b806c9b0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8012750 con 0x7fa9b806c9b0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b813d920 con 0x7fa9b806c9b0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8012ae0 con 0x7fa9b806c9b0 2023-06-23T18:49:42.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b814a180 con 0x7fa9b806c9b0 2023-06-23T18:49:42.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b81494a0 con 0x7fa9b806c9b0 2023-06-23T18:49:42.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9a8012c40 con 0x7fa9b806c9b0 2023-06-23T18:49:42.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9a8084440 con 0x7fa9b806c9b0 2023-06-23T18:49:42.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.287+0000 7fa9affff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.291+0000 7fa9affff640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 0x7fa998068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00af000 tx=0x7fa9a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.291+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9a8051660 con 0x7fa9b806c9b0 2023-06-23T18:49:42.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.479+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9b814a370 con 0x7fa9b806c9b0 2023-06-23T18:49:42.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.479+0000 7fa9b57fa640 1 -- 172.21.15.38:0/445156817 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3155 (secure 0 0 0) 0x7fa9a8054c80 con 0x7fa9b806c9b0 2023-06-23T18:49:42.487 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:42.488 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:41.169506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-23T18:49:42.488 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2023-06-23T18:49:42.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 msgr2=0x7fa998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 0x7fa998068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00af000 tx=0x7fa9a0008040 comp rx=0 tx=0).stop 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 msgr2=0x7fa9b813d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d5f0 tx=0x7fa9a800dab0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 shutdown_connections 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa998066280 0x7fa998068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b814b930 0x7fa9b81e9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9b80bd1e0 0x7fa9b81e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 --2- 172.21.15.38:0/445156817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9b806c9b0 0x7fa9b813d3e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 >> 172.21.15.38:0/445156817 conn(0x7fa9b80c0c90 msgr2=0x7fa9b80bf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:42.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 shutdown_connections 2023-06-23T18:49:42.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.483+0000 7fa9be519640 1 -- 172.21.15.38:0/445156817 wait complete. 2023-06-23T18:49:42.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:42.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.623+0000 7fe12e068640 1 Processor -- start 2023-06-23T18:49:42.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.623+0000 7fe12e068640 1 -- start start 2023-06-23T18:49:42.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe12e068640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe12814b930 0x7fe12806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe12e068640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1280bd1e0 0x7fe128070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe12e068640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1280ba9d0 con 0x7fe12806c9b0 2023-06-23T18:49:42.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe12e068640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1280bc300 con 0x7fe1280bd1e0 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe12e068640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1280a5570 con 0x7fe12814b930 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1280bd1e0 0x7fe128070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe127fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe12806c9b0 0x7fe1280707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47022/0 (socket says 172.21.15.38:47022) 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe127fff640 1 -- 172.21.15.38:0/4006447637 learned_addr learned my addr 172.21.15.38:0/4006447637 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe1277fe640 1 --2- 172.21.15.38:0/4006447637 >> v2:172.21.15.81:3300/0 conn(0x7fe12814b930 0x7fe12806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 -- 172.21.15.38:0/4006447637 >> v2:172.21.15.81:3300/0 conn(0x7fe12814b930 msgr2=0x7fe12806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 --2- 172.21.15.38:0/4006447637 >> v2:172.21.15.81:3300/0 conn(0x7fe12814b930 0x7fe12806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 -- 172.21.15.38:0/4006447637 >> v1:172.21.15.38:6789/0 conn(0x7fe12806c9b0 legacy=0x7fe1280707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 -- 172.21.15.38:0/4006447637 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128150160 con 0x7fe1280bd1e0 2023-06-23T18:49:42.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe126ffd640 1 --2- 172.21.15.38:0/4006447637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280bd1e0 0x7fe128070260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1280679f0 tx=0x7fe11c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211b7fc8a4572eb7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe1267fc640 1 -- 172.21.15.38:0/4006447637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0ab5f0 con 0x7fe1280bd1e0 2023-06-23T18:49:42.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe1267fc640 1 -- 172.21.15.38:0/4006447637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c0ab750 con 0x7fe1280bd1e0 2023-06-23T18:49:42.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.627+0000 7fe1267fc640 1 -- 172.21.15.38:0/4006447637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0abae0 con 0x7fe1280bd1e0 2023-06-23T18:49:42.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/4006447637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280bd1e0 msgr2=0x7fe128070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- 172.21.15.38:0/4006447637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280bd1e0 0x7fe128070260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1280679f0 tx=0x7fe11c01c3d0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/4006447637 shutdown_connections 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- 172.21.15.38:0/4006447637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280bd1e0 0x7fe128070260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- 172.21.15.38:0/4006447637 >> v2:172.21.15.81:3300/0 conn(0x7fe12814b930 0x7fe12806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/4006447637 >> 172.21.15.38:0/4006447637 conn(0x7fe1280c0c90 msgr2=0x7fe1280bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/4006447637 shutdown_connections 2023-06-23T18:49:42.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/4006447637 wait complete. 2023-06-23T18:49:42.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 Processor -- start 2023-06-23T18:49:42.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- start start 2023-06-23T18:49:42.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe12806c9b0 0x7fe1281e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280bd1e0 0x7fe128148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12813cf70 con 0x7fe12814b930 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281ea790 con 0x7fe1280bd1e0 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12806ff30 con 0x7fe12806c9b0 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56660/0 (socket says 172.21.15.38:56660) 2023-06-23T18:49:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 -- 172.21.15.38:0/1171775882 learned_addr learned my addr 172.21.15.38:0/1171775882 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe126ffd640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280bd1e0 0x7fe128148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe1277fe640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe12806c9b0 0x7fe1281e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 -- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe12806c9b0 msgr2=0x7fe1281e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe12806c9b0 0x7fe1281e9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 -- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280bd1e0 msgr2=0x7fe128148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280bd1e0 0x7fe128148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 -- 172.21.15.38:0/1171775882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c009420 con 0x7fe12814b930 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe127fff640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe12000cbc0 tx=0x7fe12000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000ad40 con 0x7fe12814b930 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120012400 con 0x7fe12814b930 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1281e7640 con 0x7fe12814b930 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000aea0 con 0x7fe12814b930 2023-06-23T18:49:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12814d4b0 con 0x7fe12814b930 2023-06-23T18:49:42.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.631+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1281ea900 con 0x7fe12814b930 2023-06-23T18:49:42.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.635+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe120007070 con 0x7fe12814b930 2023-06-23T18:49:42.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.635+0000 7fe10ffff640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 0x7fe114068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:42.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.635+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe120083e60 con 0x7fe12814b930 2023-06-23T18:49:42.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.635+0000 7fe1277fe640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 0x7fe114068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:42.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.635+0000 7fe1277fe640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 0x7fe114068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1180096f0 tx=0x7fe118008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:42.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.639+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1200510a0 con 0x7fe12814b930 2023-06-23T18:49:42.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.787+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe12804d790 con 0x7fe12814b930 2023-06-23T18:49:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.787+0000 7fe10ffff640 1 -- 172.21.15.38:0/1171775882 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fe120017090 con 0x7fe12814b930 2023-06-23T18:49:42.796 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:42.796 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 msgr2=0x7fe114068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 0x7fe114068760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1180096f0 tx=0x7fe118008040 comp rx=0 tx=0).stop 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 msgr2=0x7fe12806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe12000cbc0 tx=0x7fe12000a430 comp rx=0 tx=0).stop 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 shutdown_connections 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe1140662b0 0x7fe114068760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe12814b930 0x7fe12806edf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280bd1e0 0x7fe128148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 --2- 172.21.15.38:0/1171775882 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe12806c9b0 0x7fe1281e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 >> 172.21.15.38:0/1171775882 conn(0x7fe1280c0c90 msgr2=0x7fe1280bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 shutdown_connections 2023-06-23T18:49:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:42.791+0000 7fe12e068640 1 -- 172.21.15.38:0/1171775882 wait complete. 2023-06-23T18:49:43.014 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T18:49:36.741321+0000', 'modified': '2023-06-23T18:49:41.169506+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6833/4127630669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4127630669}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4127630669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-23T18:49:43.015 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T18:49:43.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-23T18:49:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 Processor -- start 2023-06-23T18:49:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 -- start start 2023-06-23T18:49:43.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29e80bc4f0 0x7f29e814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e80b9ca0 con 0x7f29e80bd9b0 2023-06-23T18:49:43.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e80a55b0 con 0x7f29e80bc4f0 2023-06-23T18:49:43.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29ed6b3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80714a0 con 0x7f29e806c6d0 2023-06-23T18:49:43.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29e6ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29dffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29e80bd9b0 0x7f29e80a4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:48220/0 (socket says 172.21.15.38:48220) 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29dffff640 1 -- 172.21.15.38:0/28774966 learned_addr learned my addr 172.21.15.38:0/28774966 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.139+0000 7f29e77fe640 1 --2- 172.21.15.38:0/28774966 >> v2:172.21.15.81:3300/0 conn(0x7f29e80bc4f0 0x7f29e814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e6ffd640 1 -- 172.21.15.38:0/28774966 >> v2:172.21.15.81:3300/0 conn(0x7f29e80bc4f0 msgr2=0x7f29e814a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/28774966 >> v2:172.21.15.81:3300/0 conn(0x7f29e80bc4f0 0x7f29e814a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e6ffd640 1 -- 172.21.15.38:0/28774966 >> v1:172.21.15.81:6789/0 conn(0x7f29e80bd9b0 legacy=0x7f29e80a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e6ffd640 1 -- 172.21.15.38:0/28774966 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e806a3f0 con 0x7f29e806c6d0 2023-06-23T18:49:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/28774966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8070f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097c0 tx=0x7f29d801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31879f7e37d24a86 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e67fc640 1 -- 172.21.15.38:0/28774966 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80ab5f0 con 0x7f29e806c6d0 2023-06-23T18:49:43.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e67fc640 1 -- 172.21.15.38:0/28774966 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d80ab750 con 0x7f29e806c6d0 2023-06-23T18:49:43.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29e67fc640 1 -- 172.21.15.38:0/28774966 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80abae0 con 0x7f29e806c6d0 2023-06-23T18:49:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 -- 172.21.15.38:0/28774966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 msgr2=0x7f29e8070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/28774966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8070f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097c0 tx=0x7f29d801c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 -- 172.21.15.38:0/28774966 shutdown_connections 2023-06-23T18:49:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/28774966 >> v2:172.21.15.81:3300/0 conn(0x7f29e80bc4f0 0x7f29e814a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/28774966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8070f60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 -- 172.21.15.38:0/28774966 >> 172.21.15.38:0/28774966 conn(0x7f29e80c0c90 msgr2=0x7f29e80bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 -- 172.21.15.38:0/28774966 shutdown_connections 2023-06-23T18:49:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.143+0000 7f29ed6b3640 1 -- 172.21.15.38:0/28774966 wait complete. 2023-06-23T18:49:43.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 Processor -- start 2023-06-23T18:49:43.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- start start 2023-06-23T18:49:43.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e80bc4f0 0x7f29e80b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80b7000 con 0x7f29e80bd9b0 2023-06-23T18:49:43.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80b5bb0 con 0x7f29e80bc4f0 2023-06-23T18:49:43.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e8155650 con 0x7f29e806c6d0 2023-06-23T18:49:43.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56674/0 (socket says 172.21.15.38:56674) 2023-06-23T18:49:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 -- 172.21.15.38:0/1979870830 learned_addr learned my addr 172.21.15.38:0/1979870830 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29dffff640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e80bc4f0 0x7f29e80b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 -- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 msgr2=0x7f29e8143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 -- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e80bc4f0 msgr2=0x7f29e80b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e80bc4f0 0x7f29e80b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 -- 172.21.15.38:0/1979870830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d8009420 con 0x7f29e80bd9b0 2023-06-23T18:49:43.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29e77fe640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29e000efc0 tx=0x7f29e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29df7fe640 1 -- 172.21.15.38:0/1979870830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0014480 con 0x7f29e80bd9b0 2023-06-23T18:49:43.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29df7fe640 1 -- 172.21.15.38:0/1979870830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e000f040 con 0x7f29e80bd9b0 2023-06-23T18:49:43.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29df7fe640 1 -- 172.21.15.38:0/1979870830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0014820 con 0x7f29e80bd9b0 2023-06-23T18:49:43.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e8155300 con 0x7f29e80bd9b0 2023-06-23T18:49:43.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.147+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e80b9640 con 0x7f29e80bd9b0 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29df7fe640 1 -- 172.21.15.38:0/1979870830 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29e0014980 con 0x7f29e80bd9b0 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29df7fe640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 0x7f29c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29df7fe640 1 -- 172.21.15.38:0/1979870830 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29e0084c00 con 0x7f29e80bd9b0 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 0x7f29c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 Processor -- start 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 -- start start 2023-06-23T18:49:43.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 0x7f29c8068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29d80af000 tx=0x7f29d80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90490 0x559741b90860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90da0 0x559741b91170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x559741a57ac0 con 0x559741bc95d0 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559741991840 con 0x559741b90490 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597419e52e0 con 0x559741b90da0 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56678/0 (socket says 172.21.15.38:56678) 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 -- 172.21.15.38:0/2171579966 learned_addr learned my addr 172.21.15.38:0/2171579966 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29dffff640 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90490 0x559741b90860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e77fe640 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90da0 0x559741b91170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 -- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90da0 msgr2=0x559741b91170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90da0 0x559741b91170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 -- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90490 msgr2=0x559741b90860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90490 0x559741b90860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 -- 172.21.15.38:0/2171579966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597416da890 con 0x559741bc95d0 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d801aaa0 tx=0x7f29d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c622c4cb90c4610d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29dcff9640 1 -- 172.21.15.38:0/2171579966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80cb630 con 0x559741bc95d0 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29dcff9640 1 -- 172.21.15.38:0/2171579966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d80c6070 con 0x559741bc95d0 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.151+0000 7f29dcff9640 1 -- 172.21.15.38:0/2171579966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80cb990 con 0x559741bc95d0 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/2171579966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 msgr2=0x559741b8ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d801aaa0 tx=0x7f29d8004740 comp rx=0 tx=0).stop 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/2171579966 shutdown_connections 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90da0 0x559741b91170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90490 0x559741b90860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2171579966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741b8ff50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/2171579966 >> 172.21.15.38:0/2171579966 conn(0x559741b87a10 msgr2=0x559741b8e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/2171579966 shutdown_connections 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/2171579966 wait complete. 2023-06-23T18:49:43.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- start start 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 Processor -- start 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741b961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741bca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597419de380 con 0x559741b90da0 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974199aae0 con 0x559741bc95d0 2023-06-23T18:49:43.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974199a780 con 0x559741b90490 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 10 client.0 _ll_register_callbacks cb 0x559741b7be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56686/0 (socket says 172.21.15.38:56686) 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 -- 172.21.15.38:0/233708382 learned_addr learned my addr 172.21.15.38:0/233708382 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741b961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 -- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 msgr2=0x559741b961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e77fe640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741bca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741b961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 -- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 msgr2=0x559741bca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741bca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 -- 172.21.15.38:0/233708382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d80bc070 con 0x559741b90da0 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741b961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e77fe640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741bca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29dffff640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007580 tx=0x7f29d0001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b1cfbd64b6674b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007730 con 0x559741b90da0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29d0014400 con 0x559741b90da0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597419a5a20 con 0x559741b90da0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29d00145c0 con 0x559741b90da0 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 10 client.4413 fetch_fsmap learned FSMap version 6 2023-06-23T18:49:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5597419a2d10 con 0x559741b90da0 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597419a5a20 con 0x559741b90da0 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 6) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f29d001c350 con 0x559741b90da0 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 10 client.4413 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 20 client.4413 populate_metadata read hostname 'smithi038' 2023-06-23T18:49:43.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741bc8880 0x559741bc8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 4 client.4413 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T18:49:43.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 --> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559741a0d710 con 0x559741bc8880 2023-06-23T18:49:43.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741bc8880 0x559741bc8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741bc8880 0x559741bc8c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4676cf9baa95e453 server_cookie=f9c7772545a473b0 in_seq=0 out_seq=0 2023-06-23T18:49:43.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.155+0000 7f29c5ffb640 10 client.4413 ms_handle_connect on v2:172.21.15.38:6832/4127630669 2023-06-23T18:49:43.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29c5ffb640 1 -- 172.21.15.38:0/233708382 <== mds.0 v2:172.21.15.38:6832/4127630669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559741a0d710 con 0x559741bc8880 2023-06-23T18:49:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29c5ffb640 10 client.4413 handle_command_reply: tid=0 2023-06-23T18:49:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 client.4413 shutdown 2023-06-23T18:49:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 msgr2=0x559741bca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007580 tx=0x7f29d0001500 comp rx=0 tx=0).stop 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 shutdown_connections 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741bc8880 0x559741bc8c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741bca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bca2b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 --2- 172.21.15.38:0/233708382 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741b961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29c5ffb640 0 client.4413 ms_handle_reset on v2:172.21.15.38:6832/4127630669 2023-06-23T18:49:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 >> 172.21.15.38:0/233708382 conn(0x559741b87a10 msgr2=0x559741b8e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 shutdown_connections 2023-06-23T18:49:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 1 -- 172.21.15.38:0/233708382 wait complete. 2023-06-23T18:49:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.159+0000 7f29f07cf000 20 client.4413 trim_cache size 0 max 16384 2023-06-23T18:49:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.171+0000 7f29f07cf000 1 Processor -- start 2023-06-23T18:49:43.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.171+0000 7f29f07cf000 1 -- start start 2023-06-23T18:49:43.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741bda140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741b952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974169b940 con 0x559741b90da0 2023-06-23T18:49:43.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559741986450 con 0x559741bc95d0 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974197d930 con 0x559741b90490 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56702/0 (socket says 172.21.15.38:56702) 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 -- 172.21.15.38:0/1244395079 learned_addr learned my addr 172.21.15.38:0/1244395079 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 -- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 msgr2=0x559741bda140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741bda140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 -- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 msgr2=0x559741b952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741b952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 -- 172.21.15.38:0/1244395079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559741988fa0 con 0x559741b90da0 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dffff640 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007090 tx=0x7f29d000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e079694503fa7556 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dd7fa640 1 -- 172.21.15.38:0/1244395079 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0001a00 con 0x559741b90da0 2023-06-23T18:49:43.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dd7fa640 1 -- 172.21.15.38:0/1244395079 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d001c8b0 con 0x559741b90da0 2023-06-23T18:49:43.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29dd7fa640 1 -- 172.21.15.38:0/1244395079 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0005870 con 0x559741b90da0 2023-06-23T18:49:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/1244395079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 msgr2=0x559741bda680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007090 tx=0x7f29d000e000 comp rx=0 tx=0).stop 2023-06-23T18:49:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/1244395079 shutdown_connections 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741bc95d0 0x559741b952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741b90da0 0x559741bda680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- 172.21.15.38:0/1244395079 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741bda140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/1244395079 >> 172.21.15.38:0/1244395079 conn(0x559741b87a10 msgr2=0x559741b94990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/1244395079 shutdown_connections 2023-06-23T18:49:43.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/1244395079 wait complete. 2023-06-23T18:49:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- start start 2023-06-23T18:49:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 Processor -- start 2023-06-23T18:49:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741be0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90da0 0x559741be08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597419d8680 con 0x559741bc95d0 2023-06-23T18:49:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597419e2380 con 0x559741b90da0 2023-06-23T18:49:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974199d800 con 0x559741b90490 2023-06-23T18:49:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 10 client.0 _ll_register_callbacks cb 0x5597419b06c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:49:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56710/0 (socket says 172.21.15.38:56710) 2023-06-23T18:49:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 -- 172.21.15.38:0/2302267604 learned_addr learned my addr 172.21.15.38:0/2302267604 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 -- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 msgr2=0x559741be0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741be0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741be0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 -- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90da0 msgr2=0x559741be08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90da0 0x559741be08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 -- 172.21.15.38:0/2302267604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597419a2d10 con 0x559741bc95d0 2023-06-23T18:49:43.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29e77fe640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29e0082be0 tx=0x7f29e0059a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20697fdbdaecec7e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-06-23T18:49:43.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0059bd0 con 0x559741bc95d0 2023-06-23T18:49:43.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29e0059d30 con 0x559741bc95d0 2023-06-23T18:49:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.175+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559741b94020 con 0x559741bc95d0 2023-06-23T18:49:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29e005d870 con 0x559741bc95d0 2023-06-23T18:49:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 10 client.4419 fetch_fsmap learned FSMap version 6 2023-06-23T18:49:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5597416dacc0 con 0x559741bc95d0 2023-06-23T18:49:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559741b94020 con 0x559741bc95d0 2023-06-23T18:49:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 6) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f29e0005d20 con 0x559741bc95d0 2023-06-23T18:49:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2023-06-23T18:49:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 10 client.4419 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-23T18:49:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 20 client.4419 populate_metadata read hostname 'smithi038' 2023-06-23T18:49:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741be1340 0x559741be1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 4 client.4419 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-06-23T18:49:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 --> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5597419dccd0 con 0x559741be1340 2023-06-23T18:49:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741be1340 0x559741be1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29e6ffd640 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741be1340 0x559741be1710 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd08873481aac85c server_cookie=a9ded4be214c883 in_seq=0 out_seq=0 2023-06-23T18:49:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 10 client.4419 ms_handle_connect on v2:172.21.15.38:6832/4127630669 2023-06-23T18:49:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 1 -- 172.21.15.38:0/2302267604 <== mds.0 v2:172.21.15.38:6832/4127630669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5597419dccd0 con 0x559741be1340 2023-06-23T18:49:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 10 client.4419 handle_command_reply: tid=0 2023-06-23T18:49:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 client.4419 shutdown 2023-06-23T18:49:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 msgr2=0x559741be0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29e0082be0 tx=0x7f29e0059a30 comp rx=0 tx=0).stop 2023-06-23T18:49:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 shutdown_connections 2023-06-23T18:49:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x559741be1340 0x559741be1710 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559741bc95d0 0x559741be0e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559741b90da0 0x559741be08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 --2- 172.21.15.38:0/2302267604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x559741b90490 0x559741be0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29c5ffb640 0 client.4419 ms_handle_reset on v2:172.21.15.38:6832/4127630669 2023-06-23T18:49:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 >> 172.21.15.38:0/2302267604 conn(0x559741b87a10 msgr2=0x559741bd9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 shutdown_connections 2023-06-23T18:49:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 1 -- 172.21.15.38:0/2302267604 wait complete. 2023-06-23T18:49:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29f07cf000 20 client.4419 trim_cache size 0 max 16384 2023-06-23T18:49:43.203 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:49:43.203 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5", 2023-06-23T18:49:43.203 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-06-23T18:49:43.204 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4266, 2023-06-23T18:49:43.204 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-06-23T18:49:43.204 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-06-23T18:49:43.204 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-06-23T18:49:43.205 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 6.4386586709999998, 2023-06-23T18:49:43.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2023-06-23T18:49:43.205 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 28, 2023-06-23T18:49:43.205 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 27, 2023-06-23T18:49:43.206 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 10.745063563 2023-06-23T18:49:43.206 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:49:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 msgr2=0x7f29c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 0x7f29c8068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29d80af000 tx=0x7f29d80a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 msgr2=0x7f29e80b9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29e000efc0 tx=0x7f29e000c490 comp rx=0 tx=0).stop 2023-06-23T18:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 shutdown_connections 2023-06-23T18:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29c8066280 0x7f29c8068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29e80bd9b0 0x7f29e80b9100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e80bc4f0 0x7f29e80b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 --2- 172.21.15.38:0/1979870830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29e806c6d0 0x7f29e8143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 >> 172.21.15.38:0/1979870830 conn(0x7f29e80c0c90 msgr2=0x7f29e80bb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 shutdown_connections 2023-06-23T18:49:43.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.179+0000 7f29ed6b3640 1 -- 172.21.15.38:0/1979870830 wait complete. 2023-06-23T18:49:43.212 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T18:49:43.213 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:43.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:49:43.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 Processor -- start 2023-06-23T18:49:43.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 -- start start 2023-06-23T18:49:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 0x7f2fdc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 0x7f2fdc0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0b9ca0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0714a0 con 0x7f2fdc0bd9b0 2023-06-23T18:49:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe42ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc06a3f0 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe1888640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 0x7f2fdc0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe2089640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 0x7f2fdc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe288a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2fdc0bc4f0 0x7f2fdc14a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:48226/0 (socket says 172.21.15.38:48226) 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.315+0000 7f2fe288a640 1 -- 172.21.15.38:0/996356000 learned_addr learned my addr 172.21.15.38:0/996356000 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe2089640 1 -- 172.21.15.38:0/996356000 >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 msgr2=0x7f2fdc0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe2089640 1 --2- 172.21.15.38:0/996356000 >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 0x7f2fdc0a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe2089640 1 -- 172.21.15.38:0/996356000 >> v1:172.21.15.81:6789/0 conn(0x7f2fdc0bc4f0 legacy=0x7f2fdc14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe2089640 1 -- 172.21.15.38:0/996356000 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0ba390 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe1888640 1 --2- 172.21.15.38:0/996356000 >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 0x7f2fdc0a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe2089640 1 --2- 172.21.15.38:0/996356000 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 0x7f2fdc070f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80097c0 tx=0x7f2fd801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b07a5c4020962cb6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe1087640 1 -- 172.21.15.38:0/996356000 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ab600 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe1087640 1 -- 172.21.15.38:0/996356000 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a7050 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe1087640 1 -- 172.21.15.38:0/996356000 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ab980 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 -- 172.21.15.38:0/996356000 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 msgr2=0x7f2fdc070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/996356000 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 0x7f2fdc070f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80097c0 tx=0x7f2fd801c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 -- 172.21.15.38:0/996356000 shutdown_connections 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/996356000 >> v2:172.21.15.81:3300/0 conn(0x7f2fdc0bd9b0 0x7f2fdc0a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/996356000 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc06c6d0 0x7f2fdc070f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 -- 172.21.15.38:0/996356000 >> 172.21.15.38:0/996356000 conn(0x7f2fdc0c0c90 msgr2=0x7f2fdc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 -- 172.21.15.38:0/996356000 shutdown_connections 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.319+0000 7f2fe42ed640 1 -- 172.21.15.38:0/996356000 wait complete. 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 Processor -- start 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- start start 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fdc06c6d0 0x7f2fdc1e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc0bd9b0 0x7f2fdc14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc155640 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc151400 con 0x7f2fdc06c6d0 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1519c0 con 0x7f2fdc0bd9b0 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56716/0 (socket says 172.21.15.38:56716) 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 -- 172.21.15.38:0/1814411741 learned_addr learned my addr 172.21.15.38:0/1814411741 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe2089640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fdc06c6d0 0x7f2fdc1e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe288a640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc0bd9b0 0x7f2fdc14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 -- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc0bd9b0 msgr2=0x7f2fdc14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc0bd9b0 0x7f2fdc14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 -- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fdc06c6d0 msgr2=0x7f2fdc1e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fdc06c6d0 0x7f2fdc1e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 -- 172.21.15.38:0/1814411741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009420 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe1888640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00ec10 tx=0x7f2fcc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00cc30 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00cd90 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd8009420 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc013690 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc151700 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc1ea590 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fcc0137f0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.323+0000 7f2fd2ffd640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 0x7f2fc0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.327+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fcc0842b0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.327+0000 7f2fe2089640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 0x7f2fc0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.327+0000 7f2fe2089640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 0x7f2fc0068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ad000 tx=0x7f2fd80a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.327+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fcc0514d0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.515+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2fdc14daf0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.515+0000 7f2fd2ffd640 1 -- 172.21.15.38:0/1814411741 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2fcc054af0 con 0x7f2fdc0bc4f0 2023-06-23T18:49:43.523 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T18:49:43.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 msgr2=0x7f2fc0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 0x7f2fc0068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ad000 tx=0x7f2fd80a4f90 comp rx=0 tx=0).stop 2023-06-23T18:49:43.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 msgr2=0x7f2fdc14cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:43.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00ec10 tx=0x7f2fcc00c520 comp rx=0 tx=0).stop 2023-06-23T18:49:43.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 shutdown_connections 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2fc00662b0 0x7f2fc0068760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2fdc0bd9b0 0x7f2fdc14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fdc0bc4f0 0x7f2fdc14cf50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 --2- 172.21.15.38:0/1814411741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fdc06c6d0 0x7f2fdc1e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 >> 172.21.15.38:0/1814411741 conn(0x7f2fdc0c0c90 msgr2=0x7f2fdc149600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 shutdown_connections 2023-06-23T18:49:43.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:43.519+0000 7f2fe42ed640 1 -- 172.21.15.38:0/1814411741 wait complete. 2023-06-23T18:49:43.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-23T18:49:43.541 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:49:43.541 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-06-23T18:49:43.542 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-23T18:49:43.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:43.542 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-23T18:49:43.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T18:49:43.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:49:43.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T18:49:43.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.544 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-06-23T18:49:43.550 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:49:43.551 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:49:43.552 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-23T18:49:43.553 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:c9:24:d8:a0 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:49:43.554 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-23T18:49:43.554 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:49:43.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T18:49:43.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.555 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:49:43.556 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:49:43.556 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-06-23T18:49:43.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-06-23T18:49:43.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-06-23T18:49:43.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T18:49:43.558 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:49:43.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.635 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:49:43.684 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-06-23T18:49:43.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.686 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-06-23T18:49:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-06-23T18:49:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:49:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-23T18:49:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:49:43.753 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-23T18:49:43.754 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:49:43.754 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:49:43.754 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:49:43.754 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:49:43.754 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:49:43.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.755 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:49:43.755 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:49:43.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:49:43.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:49:43.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:49:43.756 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:49:43.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.832 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-06-23T18:49:43.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.881 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-06-23T18:49:43.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.928 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:49:43.929 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:49:43.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-23T18:49:43.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-23T18:49:43.930 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:49:43.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-23T18:49:43.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:43.998 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:49:43.998 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:49:43.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-23T18:49:43.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T18:49:43.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-23T18:49:43.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-23T18:49:44.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-23T18:49:44.000 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:49:44.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:44.094 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:49:44.094 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:49:44.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-06-23T18:49:44.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T18:49:44.095 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:49:44.114 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-23T18:49:44.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:49:44.115 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:44.159 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-23T18:49:44.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:49:44.160 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:44.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:49:44.258 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:49:44.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:49:44.309 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:49:44.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:49:44.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:44.311 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:49:44.356 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T18:49:44.356 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-23T18:49:44.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:49:44.421 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:49:44.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:49:44.473 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:49:44.474 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:49:44.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:44.475 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:49:44.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:2023-06-23T18:49:44.497+0000 7f33452e0580 -1 init, newargv = 0x560e6d6acab0 newargc=15 2023-06-23T18:49:44.507 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[32743]: starting ceph client 2023-06-23T18:49:44.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[32743]: starting fuse 2023-06-23T18:49:45.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:49:45.626 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:49:45.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:49:45.680 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:49:45.681 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:49:45.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:45.682 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:49:45.728 INFO:teuthology.orchestra.run.smithi118.stdout:45 2023-06-23T18:49:45.729 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-23T18:49:45.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T18:49:45.729 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-06-23T18:49:45.730 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-06-23T18:49:45.730 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-06-23T18:49:45.730 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-06-23T18:49:45.730 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:49:45.731 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-06-23T18:49:45.731 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-23T18:49:45.731 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-06-23T18:49:45.732 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-23T18:49:45.732 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:49:45.732 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-06-23T18:49:45.732 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-06-23T18:49:45.733 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-06-23T18:49:45.733 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-06-23T18:49:45.733 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:49:45.733 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-06-23T18:49:45.734 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T18:49:45.734 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T18:49:45.734 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T18:49:45.735 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-06-23T18:49:45.735 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-06-23T18:49:45.735 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-06-23T18:49:45.735 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T18:49:45.736 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:49:45.736 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.admin")) 2023-06-23T18:49:45.736 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-06-23T18:49:45.848 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.admin.32743.asok 2023-06-23T18:49:46.031 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32743.asok 2023-06-23T18:49:46.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:46.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32743.asok status 2023-06-23T18:49:46.191 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-06-23T18:49:46.192 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-06-23T18:49:46.192 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "8627af3e0adcb765a3c249fcc209cba9f4873e1b", 2023-06-23T18:49:46.192 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev)", 2023-06-23T18:49:46.192 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "admin", 2023-06-23T18:49:46.192 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "32743", 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-06-23T18:49:46.193 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4331, 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4331 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-06-23T18:49:46.194 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3961462330 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-06-23T18:49:46.195 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3961462330 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4331 172.21.15.118:0/3961462330", 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "172.21.15.118:0/3961462330", 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-06-23T18:49:46.196 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 6, 2023-06-23T18:49:46.197 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 28, 2023-06-23T18:49:46.197 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-06-23T18:49:46.197 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-06-23T18:49:46.197 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-06-23T18:49:46.197 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-06-23T18:49:46.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:46.206 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-06-23T18:49:46.206 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:46.213 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-06-23T18:49:46.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:46.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:46.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:46.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:46.270 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-23T18:49:46.351 INFO:teuthology.orchestra.run.smithi118.stdout:# file: . 2023-06-23T18:49:46.352 INFO:teuthology.orchestra.run.smithi118.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-23T18:49:46.352 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-06-23T18:49:46.353 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:49:46.353 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:49:46.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:46.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.527+0000 7f1a6a147640 1 Processor -- start 2023-06-23T18:49:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.527+0000 7f1a6a147640 1 -- start start 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a6a147640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a6406c6d0 0x7f1a64070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a6a147640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1a640bc4f0 0x7f1a6414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a6a147640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640b9ca0 con 0x7f1a640bd9b0 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a6a147640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640a55b0 con 0x7f1a640bc4f0 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a6a147640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640714a0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1a640bc4f0 0x7f1a6414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1a640bc4f0 0x7f1a6414a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42800/0 (socket says 172.21.15.38:42800) 2023-06-23T18:49:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 -- 172.21.15.38:0/2381902231 learned_addr learned my addr 172.21.15.38:0/2381902231 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a637fe640 1 --2- 172.21.15.38:0/2381902231 >> v2:172.21.15.81:3300/0 conn(0x7f1a6406c6d0 0x7f1a64070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 -- 172.21.15.38:0/2381902231 >> v2:172.21.15.81:3300/0 conn(0x7f1a6406c6d0 msgr2=0x7f1a64070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 --2- 172.21.15.38:0/2381902231 >> v2:172.21.15.81:3300/0 conn(0x7f1a6406c6d0 0x7f1a64070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 -- 172.21.15.38:0/2381902231 >> v1:172.21.15.81:6789/0 conn(0x7f1a640bd9b0 legacy=0x7f1a640a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 -- 172.21.15.38:0/2381902231 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6406a3f0 con 0x7f1a640bc4f0 2023-06-23T18:49:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a63fff640 1 --2- 172.21.15.38:0/2381902231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a640bc4f0 0x7f1a6414a4a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a6406a6e0 tx=0x7f1a5c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d71e19249598bb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a627fc640 1 -- 172.21.15.38:0/2381902231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a5800 con 0x7f1a640bc4f0 2023-06-23T18:49:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a627fc640 1 -- 172.21.15.38:0/2381902231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0a5960 con 0x7f1a640bc4f0 2023-06-23T18:49:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.531+0000 7f1a627fc640 1 -- 172.21.15.38:0/2381902231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a5cf0 con 0x7f1a640bc4f0 2023-06-23T18:49:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2381902231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a640bc4f0 msgr2=0x7f1a6414a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2381902231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a640bc4f0 0x7f1a6414a4a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a6406a6e0 tx=0x7f1a5c01c940 comp rx=0 tx=0).stop 2023-06-23T18:49:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2381902231 shutdown_connections 2023-06-23T18:49:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2381902231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a640bc4f0 0x7f1a6414a4a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2381902231 >> v2:172.21.15.81:3300/0 conn(0x7f1a6406c6d0 0x7f1a64070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2381902231 >> 172.21.15.38:0/2381902231 conn(0x7f1a640c0c90 msgr2=0x7f1a640bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2381902231 shutdown_connections 2023-06-23T18:49:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2381902231 wait complete. 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 Processor -- start 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- start start 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 0x7f1a6413c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640bd9b0 0x7f1a6413ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64145830 con 0x7f1a6406c6d0 2023-06-23T18:49:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641453a0 con 0x7f1a640bd9b0 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64140590 con 0x7f1a640bc4f0 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42814/0 (socket says 172.21.15.38:42814) 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 -- 172.21.15.38:0/2915732245 learned_addr learned my addr 172.21.15.38:0/2915732245 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a63fff640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640bd9b0 0x7f1a6413ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a62ffd640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 0x7f1a6413c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 -- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 msgr2=0x7f1a6413c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 0x7f1a6413c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 -- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640bd9b0 msgr2=0x7f1a6413ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640bd9b0 0x7f1a6413ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 -- 172.21.15.38:0/2915732245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009b30 con 0x7f1a6406c6d0 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a62ffd640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 0x7f1a6413c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a637fe640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400e8a0 tx=0x7f1a5400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54009510 con 0x7f1a6406c6d0 2023-06-23T18:49:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5400c940 con 0x7f1a6406c6d0 2023-06-23T18:49:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6413d2e0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400ccb0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.535+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64140800 con 0x7f1a6406c6d0 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6404d790 con 0x7f1a6406c6d0 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a54013470 con 0x7f1a6406c6d0 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a4bfff640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 0x7f1a50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a540840a0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a62ffd640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 0x7f1a50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.539+0000 7f1a62ffd640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 0x7f1a50068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a64146750 tx=0x7f1a58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.543+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a540512c0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.699+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a64145170 con 0x7f1a6406c6d0 2023-06-23T18:49:46.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.699+0000 7f1a4bfff640 1 -- 172.21.15.38:0/2915732245 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f1a540548e0 con 0x7f1a6406c6d0 2023-06-23T18:49:46.708 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:46.708 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:46.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 msgr2=0x7f1a50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 0x7f1a50068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a64146750 tx=0x7f1a58009040 comp rx=0 tx=0).stop 2023-06-23T18:49:46.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 msgr2=0x7f1a6413d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400e8a0 tx=0x7f1a5400eca0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 shutdown_connections 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a50066280 0x7f1a50068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640bd9b0 0x7f1a6413ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a640bc4f0 0x7f1a6413c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 --2- 172.21.15.38:0/2915732245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a6406c6d0 0x7f1a6413d9b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 >> 172.21.15.38:0/2915732245 conn(0x7f1a640c0c90 msgr2=0x7f1a640bc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 shutdown_connections 2023-06-23T18:49:46.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.703+0000 7f1a6a147640 1 -- 172.21.15.38:0/2915732245 wait complete. 2023-06-23T18:49:46.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:49:46.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:49:46.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 Processor -- start 2023-06-23T18:49:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 -- start start 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f348c0712c0 0x7f348c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0b6490 0x7f348c0b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0b6270 con 0x7f348c0696d0 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c071110 con 0x7f348c0712c0 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f34928d0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c14e320 con 0x7f348c0b6490 2023-06-23T18:49:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f348c0712c0 0x7f348c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f348c0712c0 0x7f348c14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42822/0 (socket says 172.21.15.38:42822) 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 -- 172.21.15.38:0/2334673520 learned_addr learned my addr 172.21.15.38:0/2334673520 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f3490e6d640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0b6490 0x7f348c0b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 -- 172.21.15.38:0/2334673520 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0b6490 msgr2=0x7f348c0b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0b6490 0x7f348c0b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 -- 172.21.15.38:0/2334673520 >> v1:172.21.15.81:6789/0 conn(0x7f348c0696d0 legacy=0x7f348c14d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.847+0000 7f348b7fe640 1 -- 172.21.15.38:0/2334673520 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0709c0 con 0x7f348c0712c0 2023-06-23T18:49:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348b7fe640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0712c0 0x7f348c14dde0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3474009870 tx=0x7f347401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75549cd236b6ccf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348affd640 1 -- 172.21.15.38:0/2334673520 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740a8a30 con 0x7f348c0712c0 2023-06-23T18:49:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348affd640 1 -- 172.21.15.38:0/2334673520 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34740a8b90 con 0x7f348c0712c0 2023-06-23T18:49:46.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348affd640 1 -- 172.21.15.38:0/2334673520 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740b0440 con 0x7f348c0712c0 2023-06-23T18:49:46.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- 172.21.15.38:0/2334673520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0712c0 msgr2=0x7f348c14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0712c0 0x7f348c14dde0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3474009870 tx=0x7f347401ed30 comp rx=0 tx=0).stop 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- 172.21.15.38:0/2334673520 shutdown_connections 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0b6490 0x7f348c0b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- 172.21.15.38:0/2334673520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0712c0 0x7f348c14dde0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- 172.21.15.38:0/2334673520 >> 172.21.15.38:0/2334673520 conn(0x7f348c0c0f40 msgr2=0x7f348c0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- 172.21.15.38:0/2334673520 shutdown_connections 2023-06-23T18:49:46.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- 172.21.15.38:0/2334673520 wait complete. 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 Processor -- start 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- start start 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0696d0 0x7f348c0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0712c0 0x7f348c1e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c145670 con 0x7f348c0b6490 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c06ffc0 con 0x7f348c0712c0 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f34928d0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0b7590 con 0x7f348c0696d0 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f3490e6d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f3490e6d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42834/0 (socket says 172.21.15.38:42834) 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f3490e6d640 1 -- 172.21.15.38:0/1597210577 learned_addr learned my addr 172.21.15.38:0/1597210577 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:46.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348b7fe640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0712c0 0x7f348c1e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.851+0000 7f348bfff640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0696d0 0x7f348c0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 -- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0696d0 msgr2=0x7f348c0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0696d0 0x7f348c0b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 -- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0712c0 msgr2=0x7f348c1e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0712c0 0x7f348c1e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 -- 172.21.15.38:0/1597210577 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740094d0 con 0x7f348c0b6490 2023-06-23T18:49:46.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3490e6d640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f347c00d560 tx=0x7f347c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0125f0 con 0x7f348c0b6490 2023-06-23T18:49:46.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c012770 con 0x7f348c0b6490 2023-06-23T18:49:46.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c012b20 con 0x7f348c0b6490 2023-06-23T18:49:46.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c145ac0 con 0x7f348c0b6490 2023-06-23T18:49:46.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1e6980 con 0x7f348c0b6490 2023-06-23T18:49:46.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c1457e0 con 0x7f348c0b6490 2023-06-23T18:49:46.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f347c012c80 con 0x7f348c0b6490 2023-06-23T18:49:46.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 0x7f346c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:46.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f347c0843e0 con 0x7f348c0b6490 2023-06-23T18:49:46.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f348bfff640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 0x7f346c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:46.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.855+0000 7f348bfff640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 0x7f346c068760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348c150610 tx=0x7f3484009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:46.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:46.859+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f348c1457e0 con 0x7f348c0b6490 2023-06-23T18:49:47.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.011+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f348c1457b0 con 0x7f348c0b6490 2023-06-23T18:49:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.011+0000 7f3488ff9640 1 -- 172.21.15.38:0/1597210577 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f347c051600 con 0x7f348c0b6490 2023-06-23T18:49:47.020 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:49:47.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 msgr2=0x7f346c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 0x7f346c068760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348c150610 tx=0x7f3484009040 comp rx=0 tx=0).stop 2023-06-23T18:49:47.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 msgr2=0x7f348c0c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f347c00d560 tx=0x7f347c00da20 comp rx=0 tx=0).stop 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 shutdown_connections 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f346c0662b0 0x7f346c068760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f348c0b6490 0x7f348c0c04e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0712c0 0x7f348c1e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 --2- 172.21.15.38:0/1597210577 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f348c0696d0 0x7f348c0b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 >> 172.21.15.38:0/1597210577 conn(0x7f348c0c0f40 msgr2=0x7f348c0bd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 shutdown_connections 2023-06-23T18:49:47.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.015+0000 7f34928d0640 1 -- 172.21.15.38:0/1597210577 wait complete. 2023-06-23T18:49:47.039 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:49:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 Processor -- start 2023-06-23T18:49:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 -- start start 2023-06-23T18:49:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07680c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0768070270 con 0x7f0768149980 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076814ff20 con 0x7f07680ba7f0 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f0770098640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07681504e0 con 0x7f076806c4b0 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076e635640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0768149980 0x7f0768070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58028/0 (socket says 172.21.15.38:58028) 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076e635640 1 -- 172.21.15.38:0/3759312573 learned_addr learned my addr 172.21.15.38:0/3759312573 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:47.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07680c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984333070 0 0) 0x7f0768070270 con 0x7f0768149980 2023-06-23T18:49:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0754003530 con 0x7f0768149980 2023-06-23T18:49:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730452235 0 0) 0x7f0754003530 con 0x7f0768149980 2023-06-23T18:49:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 msgr2=0x7f07680c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07680c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 >> v1:172.21.15.81:6789/0 conn(0x7f07680ba7f0 legacy=0x7f0768149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768150200 con 0x7f0768149980 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f0760001a00 con 0x7f0768149980 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07680c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 >> v1:172.21.15.38:6789/0 conn(0x7f0768149980 legacy=0x7f0768070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07540039b0 0x7f0754003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0754004d10 0x7f0754005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681504e0 con 0x7f07540039b0 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075400ba70 con 0x7f0754004d10 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075400bc30 con 0x7f076806c4b0 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07540039b0 0x7f0754003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076e635640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0754004d10 0x7f0754005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076d633640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 -- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 msgr2=0x7f07540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f076806c4b0 0x7f07540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 -- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0754004d10 msgr2=0x7f0754005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0754004d10 0x7f0754005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.163+0000 7f076de34640 1 -- 172.21.15.38:0/3759312573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f07540039b0 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f076de34640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07540039b0 0x7f0754003dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c80 tx=0x7f076401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eea173fb9b608f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640a5760 con 0x7f07540039b0 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640a58c0 con 0x7f07540039b0 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f076ce32640 1 -- 172.21.15.38:0/3759312573 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640a5c70 con 0x7f07540039b0 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- 172.21.15.38:0/3759312573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07540039b0 msgr2=0x7f0754003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 --2- 172.21.15.38:0/3759312573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07540039b0 0x7f0754003dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c80 tx=0x7f076401cbb0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f076e635640 1 -- 172.21.15.38:0/3759312573 reap_dead start 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- 172.21.15.38:0/3759312573 shutdown_connections 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- 172.21.15.38:0/3759312573 >> 172.21.15.38:0/3759312573 conn(0x7f07680bfe30 msgr2=0x7f07680c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- 172.21.15.38:0/3759312573 shutdown_connections 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- 172.21.15.38:0/3759312573 wait complete. 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 Processor -- start 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.167+0000 7f0770098640 1 -- start start 2023-06-23T18:49:47.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 0x7f0768144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 0x7f0768145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680b85d0 con 0x7f07680b9400 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076814fb20 con 0x7f07540039b0 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680ba140 con 0x7f07681456e0 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42856/0 (socket says 172.21.15.38:42856) 2023-06-23T18:49:47.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 -- 172.21.15.38:0/1330204073 learned_addr learned my addr 172.21.15.38:0/1330204073 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076de34640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 0x7f0768144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076d633640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 0x7f0768145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 -- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 msgr2=0x7f0768145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 0x7f0768145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 -- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 msgr2=0x7f0768144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 0x7f0768144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 -- 172.21.15.38:0/1330204073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07681ea880 con 0x7f07680b9400 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076d633640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 0x7f0768145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076de34640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 0x7f0768144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076e635640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07680a5ff0 tx=0x7f0760007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760013600 con 0x7f07680b9400 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760013760 con 0x7f07680b9400 2023-06-23T18:49:47.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681ea550 con 0x7f07680b9400 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760013af0 con 0x7f07680b9400 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07680b62f0 con 0x7f07680b9400 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07680b9f60 con 0x7f07680b9400 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0760013c50 con 0x7f07680b9400 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07600842b0 con 0x7f07680b9400 2023-06-23T18:49:47.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.171+0000 7f076de34640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.175+0000 7f076de34640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 0x7f074c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07640af000 tx=0x7f07640046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.175+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07600514d0 con 0x7f07680b9400 2023-06-23T18:49:47.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.331+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07680b6480 con 0x7f07680b9400 2023-06-23T18:49:47.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f075e7fc640 1 -- 172.21.15.38:0/1330204073 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07600170a0 con 0x7f07680b9400 2023-06-23T18:49:47.341 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:49:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 msgr2=0x7f074c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 0x7f074c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07640af000 tx=0x7f07640046d0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 msgr2=0x7f07680b9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07680a5ff0 tx=0x7f0760007a30 comp rx=0 tx=0).stop 2023-06-23T18:49:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 shutdown_connections 2023-06-23T18:49:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f074c0662b0 0x7f074c068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07680b9400 0x7f07680b9850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07681456e0 0x7f0768145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 --2- 172.21.15.38:0/1330204073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07540039b0 0x7f0768144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 >> 172.21.15.38:0/1330204073 conn(0x7f07680bfe30 msgr2=0x7f076814c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 shutdown_connections 2023-06-23T18:49:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.335+0000 7f0770098640 1 -- 172.21.15.38:0/1330204073 wait complete. 2023-06-23T18:49:47.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:49:47.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 Processor -- start 2023-06-23T18:49:47.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 -- start start 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 0x7f9e740707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e74070d10 0x7f9e74145510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e740a6710 con 0x7f9e74145a50 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7414c1c0 con 0x7f9e74070d10 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e7b239640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740a6520 con 0x7f9e7406bb90 2023-06-23T18:49:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e797d6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9e74145a50 0x7f9e7414f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58030/0 (socket says 172.21.15.38:58030) 2023-06-23T18:49:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e797d6640 1 -- 172.21.15.38:0/3553943069 learned_addr learned my addr 172.21.15.38:0/3553943069 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e73fff640 1 --2- 172.21.15.38:0/3553943069 >> v2:172.21.15.81:3300/0 conn(0x7f9e74070d10 0x7f9e74145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 0x7f9e740707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988872118 0 0) 0x7f9e740a6710 con 0x7f9e74145a50 2023-06-23T18:49:47.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e64003530 con 0x7f9e74145a50 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110610376 0 0) 0x7f9e64003530 con 0x7f9e74145a50 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 msgr2=0x7f9e740707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 0x7f9e740707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 >> v2:172.21.15.81:3300/0 conn(0x7f9e74070d10 msgr2=0x7f9e74145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 --2- 172.21.15.38:0/3553943069 >> v2:172.21.15.81:3300/0 conn(0x7f9e74070d10 0x7f9e74145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740a6070 con 0x7f9e74145a50 2023-06-23T18:49:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f9e6c001a00 con 0x7f9e74145a50 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 >> v1:172.21.15.38:6789/0 conn(0x7f9e74145a50 legacy=0x7f9e7414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e64003980 0x7f9e64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 0x7f9e640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e64004d10 0x7f9e64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400b990 con 0x7f9e64003980 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400bad0 con 0x7f9e64004d10 2023-06-23T18:49:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400bc90 con 0x7f9e7406bb90 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e64003980 0x7f9e64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 -- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 msgr2=0x7f9e640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7406bb90 0x7f9e640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 -- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e64004d10 msgr2=0x7f9e64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e64004d10 0x7f9e64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.471+0000 7f9e78fd5640 1 -- 172.21.15.38:0/3553943069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e64003530 con 0x7f9e64003980 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e64003980 0x7f9e64003d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009ae0 tx=0x7f9e6801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f5e4741afebbf3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e680a6470 con 0x7f9e64003980 2023-06-23T18:49:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e680a65d0 con 0x7f9e64003980 2023-06-23T18:49:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e737fe640 1 -- 172.21.15.38:0/3553943069 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e680a6980 con 0x7f9e64003980 2023-06-23T18:49:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- 172.21.15.38:0/3553943069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e64003980 msgr2=0x7f9e64003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 --2- 172.21.15.38:0/3553943069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e64003980 0x7f9e64003d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009ae0 tx=0x7f9e6801ca90 comp rx=0 tx=0).stop 2023-06-23T18:49:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e797d6640 1 -- 172.21.15.38:0/3553943069 reap_dead start 2023-06-23T18:49:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- 172.21.15.38:0/3553943069 shutdown_connections 2023-06-23T18:49:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- 172.21.15.38:0/3553943069 >> 172.21.15.38:0/3553943069 conn(0x7f9e740bd180 msgr2=0x7f9e740bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- 172.21.15.38:0/3553943069 shutdown_connections 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- 172.21.15.38:0/3553943069 wait complete. 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 Processor -- start 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- start start 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 0x7f9e740bc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e74144590 0x7f9e741e6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e741eaa70 con 0x7f9e740703f0 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740bc760 con 0x7f9e74144590 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e7b239640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74146540 con 0x7f9e64003980 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42872/0 (socket says 172.21.15.38:42872) 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 -- 172.21.15.38:0/854804688 learned_addr learned my addr 172.21.15.38:0/854804688 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e797d6640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e74144590 0x7f9e741e6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 0x7f9e740bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 -- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 msgr2=0x7f9e740bc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 0x7f9e740bc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 -- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e74144590 msgr2=0x7f9e741e6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e74144590 0x7f9e741e6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e73fff640 1 -- 172.21.15.38:0/854804688 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74146260 con 0x7f9e740703f0 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.475+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 0x7f9e740bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e73fff640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000e840 tx=0x7f9e6000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60009620 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000c940 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e741ea700 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000ccf0 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7406f830 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e741eabb0 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e60013470 con 0x7f9e740703f0 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 0x7f9e58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e60084130 con 0x7f9e740703f0 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 0x7f9e58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.479+0000 7f9e78fd5640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 0x7f9e58068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009ae0 tx=0x7f9e680b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.483+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e741eabb0 con 0x7f9e740703f0 2023-06-23T18:49:47.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.635+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e741eabb0 con 0x7f9e740703f0 2023-06-23T18:49:47.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.635+0000 7f9e717fa640 1 -- 172.21.15.38:0/854804688 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e741eabb0 con 0x7f9e740703f0 2023-06-23T18:49:47.642 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.635+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 msgr2=0x7f9e58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.635+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 0x7f9e58068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009ae0 tx=0x7f9e680b2040 comp rx=0 tx=0).stop 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 msgr2=0x7f9e74144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000e840 tx=0x7f9e6000ed00 comp rx=0 tx=0).stop 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 shutdown_connections 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e58066280 0x7f9e58068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e74144590 0x7f9e741e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e740703f0 0x7f9e74144050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 --2- 172.21.15.38:0/854804688 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e64003980 0x7f9e740bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 >> 172.21.15.38:0/854804688 conn(0x7f9e740bd180 msgr2=0x7f9e740bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 shutdown_connections 2023-06-23T18:49:47.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.639+0000 7f9e7b239640 1 -- 172.21.15.38:0/854804688 wait complete. 2023-06-23T18:49:47.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:49:47.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.783+0000 7f5d75f48640 1 Processor -- start 2023-06-23T18:49:47.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.783+0000 7f5d75f48640 1 -- start start 2023-06-23T18:49:47.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d75f48640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d7014ce30 0x7f5d7006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d75f48640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7014c290 con 0x7f5d700b5e20 2023-06-23T18:49:47.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d75f48640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7006c960 con 0x7f5d70145f80 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d75f48640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7014bf40 con 0x7f5d7014ce30 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d7014ce30 0x7f5d7006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6effd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5d700b5e20 0x7f5d7014c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58034/0 (socket says 172.21.15.38:58034) 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6effd640 1 -- 172.21.15.38:0/1173337818 learned_addr learned my addr 172.21.15.38:0/1173337818 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1173337818 >> v1:172.21.15.81:6789/0 conn(0x7f5d70145f80 legacy=0x7f5d70069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1173337818 >> v1:172.21.15.38:6789/0 conn(0x7f5d700b5e20 legacy=0x7f5d7014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1173337818 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70070750 con 0x7f5d7014ce30 2023-06-23T18:49:47.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6e7fc640 1 -- 172.21.15.38:0/1173337818 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365468473 0 0) 0x7f5d7014c290 con 0x7f5d700b5e20 2023-06-23T18:49:47.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/1173337818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d7006c2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acea8442fd7b42ed server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6e7fc640 1 -- 172.21.15.38:0/1173337818 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680a5850 con 0x7f5d7014ce30 2023-06-23T18:49:47.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6e7fc640 1 -- 172.21.15.38:0/1173337818 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d680a59b0 con 0x7f5d7014ce30 2023-06-23T18:49:47.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.787+0000 7f5d6e7fc640 1 -- 172.21.15.38:0/1173337818 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680a5d40 con 0x7f5d7014ce30 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1173337818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 msgr2=0x7f5d7006c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1173337818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d7006c2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6801c7d0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1173337818 shutdown_connections 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1173337818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d7006c2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1173337818 >> 172.21.15.38:0/1173337818 conn(0x7f5d700c0f40 msgr2=0x7f5d700c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1173337818 shutdown_connections 2023-06-23T18:49:47.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1173337818 wait complete. 2023-06-23T18:49:47.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 Processor -- start 2023-06-23T18:49:47.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- start start 2023-06-23T18:49:47.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700b5e20 0x7f5d70137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d70145f80 0x7f5d701380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70137580 con 0x7f5d7014ce30 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7013c8c0 con 0x7f5d700b5e20 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70138980 con 0x7f5d70145f80 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42888/0 (socket says 172.21.15.38:42888) 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1459059298 learned_addr learned my addr 172.21.15.38:0/1459059298 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700b5e20 0x7f5d70137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6effd640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d70145f80 0x7f5d701380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d70145f80 msgr2=0x7f5d701380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d70145f80 0x7f5d701380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700b5e20 msgr2=0x7f5d70137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700b5e20 0x7f5d70137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 -- 172.21.15.38:0/1459059298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009a70 con 0x7f5d7014ce30 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d680195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680b9860 con 0x7f5d7014ce30 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d680b99c0 con 0x7f5d7014ce30 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7006f130 con 0x7f5d7014ce30 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680b9d50 con 0x7f5d7014ce30 2023-06-23T18:49:47.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.791+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d70138c60 con 0x7f5d7014ce30 2023-06-23T18:49:47.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7004d790 con 0x7f5d7014ce30 2023-06-23T18:49:47.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d680ad440 con 0x7f5d7014ce30 2023-06-23T18:49:47.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d67fff640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 0x7f5d50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d6811f3a0 con 0x7f5d7014ce30 2023-06-23T18:49:47.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 0x7f5d50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.795+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 0x7f5d50068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b8c00 tx=0x7f5d60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.799+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d680ec5c0 con 0x7f5d7014ce30 2023-06-23T18:49:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.950+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d7013ca00 con 0x7f5d7014ce30 2023-06-23T18:49:47.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.950+0000 7f5d67fff640 1 -- 172.21.15.38:0/1459059298 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d680efbe0 con 0x7f5d7014ce30 2023-06-23T18:49:47.958 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:49:47.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 msgr2=0x7f5d50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 0x7f5d50068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b8c00 tx=0x7f5d60009040 comp rx=0 tx=0).stop 2023-06-23T18:49:47.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 msgr2=0x7f5d700ba5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d680195d0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 shutdown_connections 2023-06-23T18:49:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5d50066280 0x7f5d50068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d7014ce30 0x7f5d700ba5e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d70145f80 0x7f5d701380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 --2- 172.21.15.38:0/1459059298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d700b5e20 0x7f5d70137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 >> 172.21.15.38:0/1459059298 conn(0x7f5d700c0f40 msgr2=0x7f5d700b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 shutdown_connections 2023-06-23T18:49:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:47.954+0000 7f5d75f48640 1 -- 172.21.15.38:0/1459059298 wait complete. 2023-06-23T18:49:47.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:49:48.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 Processor -- start 2023-06-23T18:49:48.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 -- start start 2023-06-23T18:49:48.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ef00712c0 0x7f8ef014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef014fd20 con 0x7f8ef0134f90 2023-06-23T18:49:48.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef0132150 con 0x7f8ef0131d80 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef8044640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00b8270 con 0x7f8ef00712c0 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef55df640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ef00712c0 0x7f8ef014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef65e1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8ef0134f90 0x7f8ef014c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58046/0 (socket says 172.21.15.38:58046) 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef65e1640 1 -- 172.21.15.38:0/3683172564 learned_addr learned my addr 172.21.15.38:0/3683172564 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef55df640 1 -- 172.21.15.38:0/3683172564 >> v1:172.21.15.81:6789/0 conn(0x7f8ef0131d80 legacy=0x7f8ef0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef55df640 1 -- 172.21.15.38:0/3683172564 >> v1:172.21.15.38:6789/0 conn(0x7f8ef0134f90 legacy=0x7f8ef014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef4dde640 1 -- 172.21.15.38:0/3683172564 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451424937 0 0) 0x7f8ef014fd20 con 0x7f8ef0134f90 2023-06-23T18:49:48.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.098+0000 7f8ef55df640 1 -- 172.21.15.38:0/3683172564 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0150250 con 0x7f8ef00712c0 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef55df640 1 --2- 172.21.15.38:0/3683172564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef00712c0 0x7f8ef014bd10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00097c0 tx=0x7f8ee001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba0fb563d2803a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef4dde640 1 -- 172.21.15.38:0/3683172564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00ab600 con 0x7f8ef00712c0 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef4dde640 1 -- 172.21.15.38:0/3683172564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee00a7050 con 0x7f8ef00712c0 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef4dde640 1 -- 172.21.15.38:0/3683172564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00ab980 con 0x7f8ef00712c0 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- 172.21.15.38:0/3683172564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef00712c0 msgr2=0x7f8ef014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 --2- 172.21.15.38:0/3683172564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef00712c0 0x7f8ef014bd10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00097c0 tx=0x7f8ee001c320 comp rx=0 tx=0).stop 2023-06-23T18:49:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- 172.21.15.38:0/3683172564 shutdown_connections 2023-06-23T18:49:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 --2- 172.21.15.38:0/3683172564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef00712c0 0x7f8ef014bd10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- 172.21.15.38:0/3683172564 >> 172.21.15.38:0/3683172564 conn(0x7f8ef00c1fd0 msgr2=0x7f8ef00c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- 172.21.15.38:0/3683172564 shutdown_connections 2023-06-23T18:49:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- 172.21.15.38:0/3683172564 wait complete. 2023-06-23T18:49:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 Processor -- start 2023-06-23T18:49:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- start start 2023-06-23T18:49:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8ef00712c0 0x7f8ef012f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef0131d80 0x7f8ef0148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef01ea1e0 con 0x7f8ef0134f90 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef01492c0 con 0x7f8ef0131d80 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef8044640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef01e6210 con 0x7f8ef00712c0 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42892/0 (socket says 172.21.15.38:42892) 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 -- 172.21.15.38:0/2189221285 learned_addr learned my addr 172.21.15.38:0/2189221285 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef5de0640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8ef00712c0 0x7f8ef012f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef55df640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef0131d80 0x7f8ef0148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 -- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8ef00712c0 msgr2=0x7f8ef012f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8ef00712c0 0x7f8ef012f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 -- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef0131d80 msgr2=0x7f8ef0148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef0131d80 0x7f8ef0148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.102+0000 7f8ef65e1640 1 -- 172.21.15.38:0/2189221285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee0009420 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef65e1640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c7b0 tx=0x7f8ee800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800a640 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800a7c0 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef012ed20 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800ab70 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef01ea3f0 con 0x7f8ef0134f90 2023-06-23T18:49:48.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004d790 con 0x7f8ef0134f90 2023-06-23T18:49:48.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ee800acd0 con 0x7f8ef0134f90 2023-06-23T18:49:48.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 0x7f8ed4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ee8083800 con 0x7f8ef0134f90 2023-06-23T18:49:48.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef5de0640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 0x7f8ed4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.106+0000 7f8ef5de0640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 0x7f8ed4068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007fd0 tx=0x7f8eec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.110+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ee8050990 con 0x7f8ef0134f90 2023-06-23T18:49:48.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.258+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8ef0130190 con 0x7f8ef0134f90 2023-06-23T18:49:48.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.258+0000 7f8ee67fc640 1 -- 172.21.15.38:0/2189221285 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ee8018020 con 0x7f8ef0134f90 2023-06-23T18:49:48.267 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:49:48.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 msgr2=0x7f8ed4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 0x7f8ed4068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007fd0 tx=0x7f8eec009040 comp rx=0 tx=0).stop 2023-06-23T18:49:48.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 msgr2=0x7f8ef012e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c7b0 tx=0x7f8ee800cc70 comp rx=0 tx=0).stop 2023-06-23T18:49:48.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 shutdown_connections 2023-06-23T18:49:48.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8ed4066280 0x7f8ed4068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ef0134f90 0x7f8ef012e7e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef0131d80 0x7f8ef0148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 --2- 172.21.15.38:0/2189221285 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8ef00712c0 0x7f8ef012f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 >> 172.21.15.38:0/2189221285 conn(0x7f8ef00c1fd0 msgr2=0x7f8ef0149d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 shutdown_connections 2023-06-23T18:49:48.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.262+0000 7f8ef8044640 1 -- 172.21.15.38:0/2189221285 wait complete. 2023-06-23T18:49:48.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:49:48.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.394+0000 7fb8d6833640 1 Processor -- start 2023-06-23T18:49:48.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.394+0000 7fb8d6833640 1 -- start start 2023-06-23T18:49:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d6833640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8d00c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d6833640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d0152830 con 0x7fb8d00a30c0 2023-06-23T18:49:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d6833640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00c22a0 con 0x7fb8d00bea40 2023-06-23T18:49:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d6833640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d006aeb0 con 0x7fb8d00a35f0 2023-06-23T18:49:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8cf7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8d00a30c0 0x7fb8d006a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58060/0 (socket says 172.21.15.38:58060) 2023-06-23T18:49:48.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8cf7fe640 1 -- 172.21.15.38:0/1126265592 learned_addr learned my addr 172.21.15.38:0/1126265592 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:48.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8d00c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268047488 0 0) 0x7fb8d0152830 con 0x7fb8d00a30c0 2023-06-23T18:49:48.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b8003530 con 0x7fb8d00a30c0 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636083668 0 0) 0x7fb8b8003530 con 0x7fb8d00a30c0 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 msgr2=0x7fb8d00c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8d00c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 >> v1:172.21.15.81:6789/0 conn(0x7fb8d00bea40 legacy=0x7fb8d006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00c2870 con 0x7fb8d00a30c0 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fb8c4001680 con 0x7fb8d00a30c0 2023-06-23T18:49:48.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 >> v1:172.21.15.38:6789/0 conn(0x7fb8d00a30c0 legacy=0x7fb8d006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b80039b0 0x7fb8b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8b8004d10 0x7fb8b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d006aeb0 con 0x7fb8b8004d10 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800bad0 con 0x7fb8b80039b0 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800bc90 con 0x7fb8d00a35f0 2023-06-23T18:49:48.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8b8004d10 0x7fb8b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8cf7fe640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8cffff640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b80039b0 0x7fb8b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 msgr2=0x7fb8b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00a35f0 0x7fb8b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b80039b0 msgr2=0x7fb8b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b80039b0 0x7fb8b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.398+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/1126265592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8003530 con 0x7fb8b8004d10 2023-06-23T18:49:48.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8b8004d10 0x7fb8b8005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009fc0 tx=0x7fb8c801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282fabbe02aa8b71 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80a5b60 con 0x7fb8b8004d10 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c800f040 con 0x7fb8b8004d10 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ceffd640 1 -- 172.21.15.38:0/1126265592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80ad440 con 0x7fb8b8004d10 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/1126265592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8b8004d10 msgr2=0x7fb8b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 --2- 172.21.15.38:0/1126265592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8b8004d10 0x7fb8b8005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009fc0 tx=0x7fb8c801cc60 comp rx=0 tx=0).stop 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/1126265592 reap_dead start 2023-06-23T18:49:48.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/1126265592 shutdown_connections 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/1126265592 >> 172.21.15.38:0/1126265592 conn(0x7fb8d00a5cc0 msgr2=0x7fb8d00a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/1126265592 shutdown_connections 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/1126265592 wait complete. 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 Processor -- start 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- start start 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d00b7f20 0x7fb8d014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00b82f0 0x7fb8d014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00b8e80 con 0x7fb8d01e2a50 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d014b460 con 0x7fb8d00b7f20 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00b87e0 con 0x7fb8d00b82f0 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42910/0 (socket says 172.21.15.38:42910) 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/2070789740 learned_addr learned my addr 172.21.15.38:0/2070789740 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8cffff640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d00b7f20 0x7fb8d014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8cf7fe640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00b82f0 0x7fb8d014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00b82f0 msgr2=0x7fb8d014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00b82f0 0x7fb8d014af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d00b7f20 msgr2=0x7fb8d014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d00b7f20 0x7fb8d014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 -- 172.21.15.38:0/2070789740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00a9c70 con 0x7fb8d01e2a50 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d4dd0640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8002240 tx=0x7fb8c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80039a0 con 0x7fb8d01e2a50 2023-06-23T18:49:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8003b00 con 0x7fb8d01e2a50 2023-06-23T18:49:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8003e70 con 0x7fb8d01e2a50 2023-06-23T18:49:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d01d8de0 con 0x7fb8d01e2a50 2023-06-23T18:49:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.402+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00a9660 con 0x7fb8d01e2a50 2023-06-23T18:49:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d00a9e60 con 0x7fb8d01e2a50 2023-06-23T18:49:48.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8c80b4040 con 0x7fb8d01e2a50 2023-06-23T18:49:48.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8ccff9640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 0x7fb8bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb8c80a5e40 con 0x7fb8d01e2a50 2023-06-23T18:49:48.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8cffff640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 0x7fb8bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.406+0000 7fb8cffff640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 0x7fb8bc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000c10 tx=0x7fb8c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.410+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8c80ead50 con 0x7fb8d01e2a50 2023-06-23T18:49:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.574+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb8d014f9b0 con 0x7fb8d01e2a50 2023-06-23T18:49:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.574+0000 7fb8ccff9640 1 -- 172.21.15.38:0/2070789740 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb8c80be080 con 0x7fb8d01e2a50 2023-06-23T18:49:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 msgr2=0x7fb8bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 0x7fb8bc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000c10 tx=0x7fb8c0009040 comp rx=0 tx=0).stop 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 msgr2=0x7fb8d01e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8002240 tx=0x7fb8c8009750 comp rx=0 tx=0).stop 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 shutdown_connections 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb8bc0662b0 0x7fb8bc068760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d01e2a50 0x7fb8d01e2ed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8d00b82f0 0x7fb8d014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 --2- 172.21.15.38:0/2070789740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d00b7f20 0x7fb8d014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 >> 172.21.15.38:0/2070789740 conn(0x7fb8d00a5cc0 msgr2=0x7fb8d00bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 shutdown_connections 2023-06-23T18:49:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.578+0000 7fb8d6833640 1 -- 172.21.15.38:0/2070789740 wait complete. 2023-06-23T18:49:48.600 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:49:48.601 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:49:48.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.718+0000 7f829071b640 1 Processor -- start 2023-06-23T18:49:48.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 -- start start 2023-06-23T18:49:48.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f828806df50 0x7f828814b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82880b4e10 0x7f828814b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f828806e7d0 0x7f828814c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82880b7920 con 0x7f82880b4e10 2023-06-23T18:49:48.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828814bb80 con 0x7f828806e7d0 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f829071b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880bd210 con 0x7f828806df50 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82880b4e10 0x7f828814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82880b4e10 0x7f828814b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42924/0 (socket says 172.21.15.38:42924) 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 -- 172.21.15.38:0/2285481525 learned_addr learned my addr 172.21.15.38:0/2285481525 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828e4b7640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f828806df50 0x7f828814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828ecb8640 1 --2- 172.21.15.38:0/2285481525 >> v2:172.21.15.81:3300/0 conn(0x7f828806e7d0 0x7f828814c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 -- 172.21.15.38:0/2285481525 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f828806df50 msgr2=0x7f828814b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f828806df50 0x7f828814b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 -- 172.21.15.38:0/2285481525 >> v2:172.21.15.81:3300/0 conn(0x7f828806e7d0 msgr2=0x7f828814c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 --2- 172.21.15.38:0/2285481525 >> v2:172.21.15.81:3300/0 conn(0x7f828806e7d0 0x7f828814c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 -- 172.21.15.38:0/2285481525 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880bd4f0 con 0x7f82880b4e10 2023-06-23T18:49:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828dcb6640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82880b4e10 0x7f828814b640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82880bd9d0 tx=0x7f827801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640e11371ee1cdc6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828d4b5640 1 -- 172.21.15.38:0/2285481525 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780ad680 con 0x7f82880b4e10 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828d4b5640 1 -- 172.21.15.38:0/2285481525 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780ad7e0 con 0x7f82880b4e10 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.722+0000 7f828d4b5640 1 -- 172.21.15.38:0/2285481525 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780adb70 con 0x7f82880b4e10 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/2285481525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82880b4e10 msgr2=0x7f828814b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82880b4e10 0x7f828814b640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82880bd9d0 tx=0x7f827801c4b0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/2285481525 shutdown_connections 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- 172.21.15.38:0/2285481525 >> v2:172.21.15.81:3300/0 conn(0x7f828806e7d0 0x7f828814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82880b4e10 0x7f828814b640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- 172.21.15.38:0/2285481525 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f828806df50 0x7f828814b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/2285481525 >> 172.21.15.38:0/2285481525 conn(0x7f82880bfca0 msgr2=0x7f82880c00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/2285481525 shutdown_connections 2023-06-23T18:49:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/2285481525 wait complete. 2023-06-23T18:49:48.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 Processor -- start 2023-06-23T18:49:48.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- start start 2023-06-23T18:49:48.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 0x7f8288146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82880b4e10 0x7f8288140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8288147330 con 0x7f828806e7d0 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828813b740 con 0x7f828806df50 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8288139030 con 0x7f82880b4e10 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42934/0 (socket says 172.21.15.38:42934) 2023-06-23T18:49:48.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 -- 172.21.15.38:0/50634037 learned_addr learned my addr 172.21.15.38:0/50634037 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828ecb8640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82880b4e10 0x7f8288140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828e4b7640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 0x7f8288146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 -- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82880b4e10 msgr2=0x7f8288140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82880b4e10 0x7f8288140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 -- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 msgr2=0x7f8288146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 0x7f8288146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 -- 172.21.15.38:0/50634037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780094d0 con 0x7f828806e7d0 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828e4b7640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 0x7f8288146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f828dcb6640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f827801cd50 tx=0x7f8278019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780ade20 con 0x7f828806e7d0 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780b6420 con 0x7f828806e7d0 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82881475c0 con 0x7f828806e7d0 2023-06-23T18:49:48.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b67d0 con 0x7f828806e7d0 2023-06-23T18:49:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.726+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828813b970 con 0x7f828806e7d0 2023-06-23T18:49:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828804d790 con 0x7f828806e7d0 2023-06-23T18:49:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82780b4070 con 0x7f828806e7d0 2023-06-23T18:49:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f827effd640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 0x7f826c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f827811df60 con 0x7f828806e7d0 2023-06-23T18:49:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f828e4b7640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 0x7f826c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.730+0000 7f828e4b7640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 0x7f826c068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82840097c0 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.734+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82780eb0f0 con 0x7f828806e7d0 2023-06-23T18:49:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.894+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82880b6480 con 0x7f828806e7d0 2023-06-23T18:49:48.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.894+0000 7f827effd640 1 -- 172.21.15.38:0/50634037 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f82780ee710 con 0x7f828806e7d0 2023-06-23T18:49:48.903 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:48.904 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 msgr2=0x7f826c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 0x7f826c068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82840097c0 tx=0x7f8284008040 comp rx=0 tx=0).stop 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 msgr2=0x7f8288145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f827801cd50 tx=0x7f8278019250 comp rx=0 tx=0).stop 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 shutdown_connections 2023-06-23T18:49:48.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f826c066280 0x7f826c068730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82880b4e10 0x7f8288140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828806e7d0 0x7f8288145610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 --2- 172.21.15.38:0/50634037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f828806df50 0x7f8288146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 >> 172.21.15.38:0/50634037 conn(0x7f82880bfca0 msgr2=0x7f82880be9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 shutdown_connections 2023-06-23T18:49:48.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:48.898+0000 7f829071b640 1 -- 172.21.15.38:0/50634037 wait complete. 2023-06-23T18:49:48.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:49:48.923 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:49:49.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.034+0000 7fb3064d7640 1 Processor -- start 2023-06-23T18:49:49.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.034+0000 7fb3064d7640 1 -- start start 2023-06-23T18:49:49.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb3064d7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb30006c4b0 0x7fb3000c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb3064d7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb300149980 0x7fb30014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb3064d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb300070270 con 0x7fb3000ba7f0 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb3064d7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3001504e0 con 0x7fb300149980 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb3064d7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30014ff20 con 0x7fb30006c4b0 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb300149980 0x7fb30014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb300149980 0x7fb30014bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42942/0 (socket says 172.21.15.38:42942) 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 -- 172.21.15.38:0/150635660 learned_addr learned my addr 172.21.15.38:0/150635660 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb2fffff640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb30006c4b0 0x7fb3000c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 -- 172.21.15.38:0/150635660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb30006c4b0 msgr2=0x7fb3000c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb30006c4b0 0x7fb3000c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 -- 172.21.15.38:0/150635660 >> v1:172.21.15.81:6789/0 conn(0x7fb3000ba7f0 legacy=0x7fb300149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 -- 172.21.15.38:0/150635660 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300150200 con 0x7fb300149980 2023-06-23T18:49:49.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb304a74640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb300149980 0x7fb30014bfa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009870 tx=0x7fb2f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267433af940a69f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb2feffd640 1 -- 172.21.15.38:0/150635660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00ab600 con 0x7fb300149980 2023-06-23T18:49:49.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb2feffd640 1 -- 172.21.15.38:0/150635660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f00a7050 con 0x7fb300149980 2023-06-23T18:49:49.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.038+0000 7fb2feffd640 1 -- 172.21.15.38:0/150635660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00ab980 con 0x7fb300149980 2023-06-23T18:49:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- 172.21.15.38:0/150635660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb300149980 msgr2=0x7fb30014bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb300149980 0x7fb30014bfa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009870 tx=0x7fb2f001c470 comp rx=0 tx=0).stop 2023-06-23T18:49:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- 172.21.15.38:0/150635660 shutdown_connections 2023-06-23T18:49:49.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb300149980 0x7fb30014bfa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- 172.21.15.38:0/150635660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb30006c4b0 0x7fb3000c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- 172.21.15.38:0/150635660 >> 172.21.15.38:0/150635660 conn(0x7fb3000bfe30 msgr2=0x7fb3000c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- 172.21.15.38:0/150635660 shutdown_connections 2023-06-23T18:49:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- 172.21.15.38:0/150635660 wait complete. 2023-06-23T18:49:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 Processor -- start 2023-06-23T18:49:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- start start 2023-06-23T18:49:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb3000ba7f0 0x7fb30013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb300149980 0x7fb300140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001e7d00 con 0x7fb30006c4b0 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001e76a0 con 0x7fb300149980 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb3064d7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30014e810 con 0x7fb3000ba7f0 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42956/0 (socket says 172.21.15.38:42956) 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 -- 172.21.15.38:0/1830318053 learned_addr learned my addr 172.21.15.38:0/1830318053 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2ff7fe640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb3000ba7f0 0x7fb30013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 -- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb3000ba7f0 msgr2=0x7fb30013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb304a74640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb300149980 0x7fb300140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb3000ba7f0 0x7fb30013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 -- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb300149980 msgr2=0x7fb300140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb300149980 0x7fb300140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 -- 172.21.15.38:0/1830318053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00094d0 con 0x7fb30006c4b0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fffff640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8007ef0 tx=0x7fb2f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8014620 con 0x7fb30006c4b0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.042+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8014780 con 0x7fb30006c4b0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8014b30 con 0x7fb30006c4b0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3001e7920 con 0x7fb30006c4b0 2023-06-23T18:49:49.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30014f120 con 0x7fb30006c4b0 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30004d790 con 0x7fb30006c4b0 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2f8014c90 con 0x7fb30006c4b0 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2fcff9640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 0x7fb2e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb2f8084960 con 0x7fb30006c4b0 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2ff7fe640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 0x7fb2e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.046+0000 7fb2ff7fe640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 0x7fb2e0068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8007fd0 tx=0x7fb2e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.050+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2f8051b80 con 0x7fb30006c4b0 2023-06-23T18:49:49.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.198+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3000bc6d0 con 0x7fb30006c4b0 2023-06-23T18:49:49.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.198+0000 7fb2fcff9640 1 -- 172.21.15.38:0/1830318053 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2f8082e60 con 0x7fb30006c4b0 2023-06-23T18:49:49.207 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:49:49.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.198+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 msgr2=0x7fb2e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 0x7fb2e0068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8007fd0 tx=0x7fb2e8009040 comp rx=0 tx=0).stop 2023-06-23T18:49:49.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 msgr2=0x7fb3001e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8007ef0 tx=0x7fb2f800e4b0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 shutdown_connections 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb2e0066280 0x7fb2e0068730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb300149980 0x7fb300140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb3000ba7f0 0x7fb30013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 --2- 172.21.15.38:0/1830318053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb30006c4b0 0x7fb3001e7160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 >> 172.21.15.38:0/1830318053 conn(0x7fb3000bfe30 msgr2=0x7fb3000bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 shutdown_connections 2023-06-23T18:49:49.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.202+0000 7fb3064d7640 1 -- 172.21.15.38:0/1830318053 wait complete. 2023-06-23T18:49:49.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:49:49.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 Processor -- start 2023-06-23T18:49:49.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 -- start start 2023-06-23T18:49:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48cc0bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0bb170 con 0x7f48cc06b930 2023-06-23T18:49:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc152150 con 0x7f48cc14e5a0 2023-06-23T18:49:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48d1d18640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06d050 con 0x7f48cc0b9cb0 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48cc06b930 0x7f48cc06bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58072/0 (socket says 172.21.15.38:58072) 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 -- 172.21.15.38:0/2289028698 learned_addr learned my addr 172.21.15.38:0/2289028698 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48cc0bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914466811 0 0) 0x7f48cc0bb170 con 0x7f48cc06b930 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b4003530 con 0x7f48cc06b930 2023-06-23T18:49:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867700705 0 0) 0x7f48cc152150 con 0x7f48cc14e5a0 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48cc0bb170 con 0x7f48cc14e5a0 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3949473473 0 0) 0x7f48b4003530 con 0x7f48cc06b930 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 msgr2=0x7f48cc0bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48cc0bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 >> v1:172.21.15.81:6789/0 conn(0x7f48cc14e5a0 legacy=0x7f48cc158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0bacc0 con 0x7f48cc06b930 2023-06-23T18:49:49.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f48c0001680 con 0x7f48cc06b930 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 >> v1:172.21.15.38:6789/0 conn(0x7f48cc06b930 legacy=0x7f48cc06bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b4003b40 0x7f48b4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b40047d0 0x7f48b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48b40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06d050 con 0x7f48b40047d0 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b400bb20 con 0x7f48b4003b40 2023-06-23T18:49:49.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b400bce0 con 0x7f48cc0b9cb0 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b40047d0 0x7f48b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b4003b40 0x7f48b4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48cbfff640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48b40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 -- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 msgr2=0x7f48b40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc0b9cb0 0x7f48b40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 -- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b4003b40 msgr2=0x7f48b4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b4003b40 0x7f48b4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48caffd640 1 -- 172.21.15.38:0/2289028698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4003530 con 0x7f48b40047d0 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.346+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b4003b40 0x7f48b4003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48caffd640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b40047d0 0x7f48b4004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007fa0 tx=0x7f48c001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee70206a4d03a500 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0005ae0 con 0x7f48b40047d0 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0005c40 con 0x7f48b40047d0 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48ca7fc640 1 -- 172.21.15.38:0/2289028698 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00a57e0 con 0x7f48b40047d0 2023-06-23T18:49:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 -- 172.21.15.38:0/2289028698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b40047d0 msgr2=0x7f48b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2289028698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b40047d0 0x7f48b4004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007fa0 tx=0x7f48c001cae0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48cbfff640 1 -- 172.21.15.38:0/2289028698 reap_dead start 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 -- 172.21.15.38:0/2289028698 shutdown_connections 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 -- 172.21.15.38:0/2289028698 >> 172.21.15.38:0/2289028698 conn(0x7f48cc0bd180 msgr2=0x7f48cc0bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 -- 172.21.15.38:0/2289028698 shutdown_connections 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.350+0000 7f48d1d18640 1 -- 172.21.15.38:0/2289028698 wait complete. 2023-06-23T18:49:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 Processor -- start 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- start start 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40047d0 0x7f48cc1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc144d70 0x7f48cc070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1e7170 con 0x7f48cc070ea0 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1453a0 con 0x7f48b40047d0 2023-06-23T18:49:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc150d00 con 0x7f48cc144d70 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42964/0 (socket says 172.21.15.38:42964) 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 -- 172.21.15.38:0/2813019312 learned_addr learned my addr 172.21.15.38:0/2813019312 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48caffd640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc144d70 0x7f48cc070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40047d0 0x7f48cc1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 -- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc144d70 msgr2=0x7f48cc070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc144d70 0x7f48cc070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 -- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40047d0 msgr2=0x7f48cc1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40047d0 0x7f48cc1507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 -- 172.21.15.38:0/2813019312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc1e73c0 con 0x7f48cc070ea0 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48cbfff640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48cc14e9e0 tx=0x7f48c400e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400ed10 con 0x7f48cc070ea0 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400ee70 con 0x7f48cc070ea0 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4003bc0 con 0x7f48cc070ea0 2023-06-23T18:49:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc1e76a0 con 0x7f48cc070ea0 2023-06-23T18:49:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc151810 con 0x7f48cc070ea0 2023-06-23T18:49:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc04d790 con 0x7f48cc070ea0 2023-06-23T18:49:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48c4003d20 con 0x7f48cc070ea0 2023-06-23T18:49:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 0x7f48b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.354+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48c4083240 con 0x7f48cc070ea0 2023-06-23T18:49:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.358+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 0x7f48b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.358+0000 7f48cb7fe640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 0x7f48b8068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0099d0 tx=0x7f48bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.358+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48c40503d0 con 0x7f48cc070ea0 2023-06-23T18:49:49.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48cc0a64b0 con 0x7f48cc070ea0 2023-06-23T18:49:49.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48b3fff640 1 -- 172.21.15.38:0/2813019312 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48c40539f0 con 0x7f48cc070ea0 2023-06-23T18:49:49.518 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:49:49.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 msgr2=0x7f48b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 0x7f48b8068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0099d0 tx=0x7f48bc008040 comp rx=0 tx=0).stop 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 msgr2=0x7f48cc1e9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48cc14e9e0 tx=0x7f48c400e750 comp rx=0 tx=0).stop 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 shutdown_connections 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48b8066280 0x7f48b8068730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48cc070ea0 0x7f48cc1e9c60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48cc144d70 0x7f48cc070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 --2- 172.21.15.38:0/2813019312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40047d0 0x7f48cc1507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 >> 172.21.15.38:0/2813019312 conn(0x7f48cc0bd180 msgr2=0x7f48cc0a4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 shutdown_connections 2023-06-23T18:49:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.510+0000 7f48d1d18640 1 -- 172.21.15.38:0/2813019312 wait complete. 2023-06-23T18:49:49.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:49:49.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 Processor -- start 2023-06-23T18:49:49.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 -- start start 2023-06-23T18:49:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f74580c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f74580a3850 0x7f74580bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74580c23a0 con 0x7f74580bf1a0 2023-06-23T18:49:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74580aa080 con 0x7f74580a3850 2023-06-23T18:49:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f745dc64640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74580bb060 con 0x7f74580be890 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f74580a3850 0x7f74580bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f74580a3850 0x7f74580bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42974/0 (socket says 172.21.15.38:42974) 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 -- 172.21.15.38:0/869887254 learned_addr learned my addr 172.21.15.38:0/869887254 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f74577fe640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f74580c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 -- 172.21.15.38:0/869887254 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 msgr2=0x7f74580c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f74580c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 -- 172.21.15.38:0/869887254 >> v1:172.21.15.81:6789/0 conn(0x7f74580bf1a0 legacy=0x7f745806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.654+0000 7f7456ffd640 1 -- 172.21.15.38:0/869887254 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580c3b60 con 0x7f74580a3850 2023-06-23T18:49:49.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f7456ffd640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f74580bec60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f744c0098a0 tx=0x7f744c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b280bf0ffaff2eea server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f74567fc640 1 -- 172.21.15.38:0/869887254 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0ac600 con 0x7f74580a3850 2023-06-23T18:49:49.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f74567fc640 1 -- 172.21.15.38:0/869887254 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0a8050 con 0x7f74580a3850 2023-06-23T18:49:49.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f74567fc640 1 -- 172.21.15.38:0/869887254 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0ac980 con 0x7f74580a3850 2023-06-23T18:49:49.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- 172.21.15.38:0/869887254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 msgr2=0x7f74580bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f74580bec60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f744c0098a0 tx=0x7f744c01c3c0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- 172.21.15.38:0/869887254 shutdown_connections 2023-06-23T18:49:49.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f74580bec60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 --2- 172.21.15.38:0/869887254 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f74580c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- 172.21.15.38:0/869887254 >> 172.21.15.38:0/869887254 conn(0x7f74580a5d50 msgr2=0x7f74580a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- 172.21.15.38:0/869887254 shutdown_connections 2023-06-23T18:49:49.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- 172.21.15.38:0/869887254 wait complete. 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 Processor -- start 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.658+0000 7f745dc64640 1 -- start start 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f7458150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 0x7f74581e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745814a450 con 0x7f74580a3850 2023-06-23T18:49:49.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745814b550 con 0x7f74580ba2a0 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74581e9820 con 0x7f74580be890 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42978/0 (socket says 172.21.15.38:42978) 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 -- 172.21.15.38:0/2167140691 learned_addr learned my addr 172.21.15.38:0/2167140691 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f7456ffd640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f7458150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 -- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 msgr2=0x7f7458150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f7458150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 -- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 msgr2=0x7f74581e9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f7457fff640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 0x7f74581e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 0x7f74581e9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 -- 172.21.15.38:0/2167140691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0094d0 con 0x7f74580a3850 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f7457fff640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 0x7f74581e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f74577fe640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f744800d5f0 tx=0x7f744800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480125f0 con 0x7f74580a3850 2023-06-23T18:49:49.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448012750 con 0x7f74580a3850 2023-06-23T18:49:49.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74581e9b00 con 0x7f74580a3850 2023-06-23T18:49:49.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448012ae0 con 0x7f74580a3850 2023-06-23T18:49:49.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7458151430 con 0x7f74580a3850 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745814b880 con 0x7f74580a3850 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7448012c40 con 0x7f74580a3850 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 0x7f7444068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7448084e40 con 0x7f74580a3850 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.662+0000 7f7456ffd640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 0x7f7444068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.666+0000 7f7456ffd640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 0x7f7444068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ae000 tx=0x7f744c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.666+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7448052140 con 0x7f74580a3850 2023-06-23T18:49:49.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.818+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f745804d790 con 0x7f74580a3850 2023-06-23T18:49:49.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.818+0000 7f743ffff640 1 -- 172.21.15.38:0/2167140691 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7448007380 con 0x7f74580a3850 2023-06-23T18:49:49.828 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:49:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 msgr2=0x7f7444068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 0x7f7444068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ae000 tx=0x7f744c008040 comp rx=0 tx=0).stop 2023-06-23T18:49:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 msgr2=0x7f7458158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f744800d5f0 tx=0x7f744800dab0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 shutdown_connections 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7444066280 0x7f7444068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74580ba2a0 0x7f74581e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74580be890 0x7f7458150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 --2- 172.21.15.38:0/2167140691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74580a3850 0x7f7458158530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 >> 172.21.15.38:0/2167140691 conn(0x7f74580a5d50 msgr2=0x7f74580ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 shutdown_connections 2023-06-23T18:49:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.822+0000 7f745dc64640 1 -- 172.21.15.38:0/2167140691 wait complete. 2023-06-23T18:49:49.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:49:49.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 Processor -- start 2023-06-23T18:49:49.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 -- start start 2023-06-23T18:49:49.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f67340c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6734149980 0x7f673414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6734070270 con 0x7f67340ba7f0 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67341504e0 con 0x7f6734149980 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6739b75640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673414ff20 con 0x7f673406c4b0 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6734149980 0x7f673414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6734149980 0x7f673414bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42980/0 (socket says 172.21.15.38:42980) 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 -- 172.21.15.38:0/107466131 learned_addr learned my addr 172.21.15.38:0/107466131 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f67337fe640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f67340c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 -- 172.21.15.38:0/107466131 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 msgr2=0x7f67340c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f67340c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 -- 172.21.15.38:0/107466131 >> v1:172.21.15.81:6789/0 conn(0x7f67340ba7f0 legacy=0x7f6734149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:49.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.966+0000 7f6733fff640 1 -- 172.21.15.38:0/107466131 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734150200 con 0x7f6734149980 2023-06-23T18:49:49.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f673414bfa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e50 tx=0x7f672c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3030eb0cf6b629 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f67327fc640 1 -- 172.21.15.38:0/107466131 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a55c0 con 0x7f6734149980 2023-06-23T18:49:49.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f67327fc640 1 -- 172.21.15.38:0/107466131 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0a5720 con 0x7f6734149980 2023-06-23T18:49:49.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f67327fc640 1 -- 172.21.15.38:0/107466131 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a5ab0 con 0x7f6734149980 2023-06-23T18:49:49.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- 172.21.15.38:0/107466131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 msgr2=0x7f673414bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f673414bfa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e50 tx=0x7f672c01c940 comp rx=0 tx=0).stop 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- 172.21.15.38:0/107466131 shutdown_connections 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f673414bfa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- 172.21.15.38:0/107466131 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f67340c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- 172.21.15.38:0/107466131 >> 172.21.15.38:0/107466131 conn(0x7f67340bfe30 msgr2=0x7f67340c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- 172.21.15.38:0/107466131 shutdown_connections 2023-06-23T18:49:49.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- 172.21.15.38:0/107466131 wait complete. 2023-06-23T18:49:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 Processor -- start 2023-06-23T18:49:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- start start 2023-06-23T18:49:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f673414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67340ba7f0 0x7f673413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673414e530 con 0x7f6734149980 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673414def0 con 0x7f67340ba7f0 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6739b75640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673413f640 con 0x7f673406c4b0 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42992/0 (socket says 172.21.15.38:42992) 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 -- 172.21.15.38:0/2063375600 learned_addr learned my addr 172.21.15.38:0/2063375600 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f67337fe640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f673414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6732ffd640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67340ba7f0 0x7f673413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 -- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 msgr2=0x7f673414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f673414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 -- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67340ba7f0 msgr2=0x7f673413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67340ba7f0 0x7f673413e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:49.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 -- 172.21.15.38:0/2063375600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009b30 con 0x7f6734149980 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.970+0000 7f6733fff640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e50 tx=0x7f672c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a55c0 con 0x7f6734149980 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0b8870 con 0x7f6734149980 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673413f920 con 0x7f6734149980 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0b8c20 con 0x7f6734149980 2023-06-23T18:49:49.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734140fc0 con 0x7f6734149980 2023-06-23T18:49:49.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673404d790 con 0x7f6734149980 2023-06-23T18:49:49.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f672c0b6410 con 0x7f6734149980 2023-06-23T18:49:49.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 0x7f6720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:49.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f672c11f410 con 0x7f6734149980 2023-06-23T18:49:49.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f67337fe640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 0x7f6720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:49.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.974+0000 7f67337fe640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 0x7f6720068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f67341e4cd0 tx=0x7f6724008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:49.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:49.978+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f672c0ec790 con 0x7f6734149980 2023-06-23T18:49:50.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.130+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67340bc6d0 con 0x7f6734149980 2023-06-23T18:49:50.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.130+0000 7f671bfff640 1 -- 172.21.15.38:0/2063375600 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f672c009510 con 0x7f6734149980 2023-06-23T18:49:50.139 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:49:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 msgr2=0x7f6720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 0x7f6720068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f67341e4cd0 tx=0x7f6724008040 comp rx=0 tx=0).stop 2023-06-23T18:49:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 msgr2=0x7f67341e3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f672c009e50 tx=0x7f672c0196e0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 shutdown_connections 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6720066280 0x7f6720068730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6734149980 0x7f67341e3930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67340ba7f0 0x7f673413e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 --2- 172.21.15.38:0/2063375600 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f673406c4b0 0x7f673414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 >> 172.21.15.38:0/2063375600 conn(0x7f67340bfe30 msgr2=0x7f67341417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 shutdown_connections 2023-06-23T18:49:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.134+0000 7f6739b75640 1 -- 172.21.15.38:0/2063375600 wait complete. 2023-06-23T18:49:50.158 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:49:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 Processor -- start 2023-06-23T18:49:50.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 -- start start 2023-06-23T18:49:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f48b806c4b0 0x7f48b80c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b8070270 con 0x7f48b8149980 2023-06-23T18:49:50.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b814ff20 con 0x7f48b80ba7f0 2023-06-23T18:49:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48bdbb8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b81504e0 con 0x7f48b806c4b0 2023-06-23T18:49:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f48b806c4b0 0x7f48b80c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48b8149980 0x7f48b8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58074/0 (socket says 172.21.15.38:58074) 2023-06-23T18:49:50.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b7fff640 1 -- 172.21.15.38:0/1261661157 learned_addr learned my addr 172.21.15.38:0/1261661157 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b77fe640 1 -- 172.21.15.38:0/1261661157 >> v1:172.21.15.81:6789/0 conn(0x7f48b80ba7f0 legacy=0x7f48b8149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b77fe640 1 -- 172.21.15.38:0/1261661157 >> v1:172.21.15.38:6789/0 conn(0x7f48b8149980 legacy=0x7f48b8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.274+0000 7f48b77fe640 1 -- 172.21.15.38:0/1261661157 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8150200 con 0x7f48b806c4b0 2023-06-23T18:49:50.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- 172.21.15.38:0/1261661157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b80c09d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48a80097c0 tx=0x7f48a801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f6cb7305756d01 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b67fc640 1 -- 172.21.15.38:0/1261661157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80ab600 con 0x7f48b806c4b0 2023-06-23T18:49:50.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b67fc640 1 -- 172.21.15.38:0/1261661157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a80a7050 con 0x7f48b806c4b0 2023-06-23T18:49:50.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b67fc640 1 -- 172.21.15.38:0/1261661157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80ab980 con 0x7f48b806c4b0 2023-06-23T18:49:50.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1261661157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 msgr2=0x7f48b80c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1261661157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b80c09d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48a80097c0 tx=0x7f48a801c240 comp rx=0 tx=0).stop 2023-06-23T18:49:50.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1261661157 shutdown_connections 2023-06-23T18:49:50.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1261661157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b80c09d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1261661157 >> 172.21.15.38:0/1261661157 conn(0x7f48b80bfe30 msgr2=0x7f48b80c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:50.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1261661157 shutdown_connections 2023-06-23T18:49:50.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1261661157 wait complete. 2023-06-23T18:49:50.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 Processor -- start 2023-06-23T18:49:50.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- start start 2023-06-23T18:49:50.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 0x7f48b814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48b8149980 0x7f48b80bb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80ba090 con 0x7f48b806c4b0 2023-06-23T18:49:50.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b806f1a0 con 0x7f48b80ba7f0 2023-06-23T18:49:50.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80b9d40 con 0x7f48b8149980 2023-06-23T18:49:50.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43016/0 (socket says 172.21.15.38:43016) 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 -- 172.21.15.38:0/1126855016 learned_addr learned my addr 172.21.15.38:0/1126855016 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 -- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48b8149980 msgr2=0x7f48b80bb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48b8149980 0x7f48b80bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 -- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 msgr2=0x7f48b814af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b6ffd640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 0x7f48b814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 0x7f48b814af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 -- 172.21.15.38:0/1126855016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8009420 con 0x7f48b806c4b0 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b6ffd640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 0x7f48b814af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48b77fe640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48a801a8f0 tx=0x7f48a8018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80aa8b0 con 0x7f48b806c4b0 2023-06-23T18:49:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a80aaa10 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b806fcc0 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80aada0 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.278+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b806e540 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b80b9f00 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48a80b2040 con 0x7f48b806c4b0 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f489ffff640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48a811e5f0 con 0x7f48b806c4b0 2023-06-23T18:49:50.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f48b6ffd640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.282+0000 7f48b6ffd640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 0x7f48a4068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48b8149550 tx=0x7f48ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.286+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48a80eb810 con 0x7f48b806c4b0 2023-06-23T18:49:50.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48b806f360 con 0x7f48b806c4b0 2023-06-23T18:49:50.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f489ffff640 1 -- 172.21.15.38:0/1126855016 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f48a80eee30 con 0x7f48b806c4b0 2023-06-23T18:49:50.446 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:49:50.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 msgr2=0x7f48a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 0x7f48a4068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48b8149550 tx=0x7f48ac009040 comp rx=0 tx=0).stop 2023-06-23T18:49:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 msgr2=0x7f48b806de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48a801a8f0 tx=0x7f48a8018fe0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 shutdown_connections 2023-06-23T18:49:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48b8149980 0x7f48b80bb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b80ba7f0 0x7f48b814af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 --2- 172.21.15.38:0/1126855016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48b806c4b0 0x7f48b806de30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 >> 172.21.15.38:0/1126855016 conn(0x7f48b80bfe30 msgr2=0x7f48b81486b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:50.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 shutdown_connections 2023-06-23T18:49:50.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.438+0000 7f48bdbb8640 1 -- 172.21.15.38:0/1126855016 wait complete. 2023-06-23T18:49:50.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:49:50.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 Processor -- start 2023-06-23T18:49:50.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 -- start start 2023-06-23T18:49:50.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2840a30c0 0x7fd2840a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2840bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd284152830 con 0x7fd2840bea40 2023-06-23T18:49:50.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2840bf350 con 0x7fd2840a30c0 2023-06-23T18:49:50.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd28b33f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840c22a0 con 0x7fd2840c0c70 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2840bea40 0x7fd28406a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58082/0 (socket says 172.21.15.38:58082) 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 -- 172.21.15.38:0/3401308311 learned_addr learned my addr 172.21.15.38:0/3401308311 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2888da640 1 --2- 172.21.15.38:0/3401308311 >> v2:172.21.15.81:3300/0 conn(0x7fd2840a30c0 0x7fd2840a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2898dc640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2840bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889951133 0 0) 0x7fd284152830 con 0x7fd2840bea40 2023-06-23T18:49:50.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd270003530 con 0x7fd2840bea40 2023-06-23T18:49:50.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278401267 0 0) 0x7fd270003530 con 0x7fd2840bea40 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 msgr2=0x7fd2840bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2840bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 >> v2:172.21.15.81:3300/0 conn(0x7fd2840a30c0 msgr2=0x7fd2840a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 --2- 172.21.15.38:0/3401308311 >> v2:172.21.15.81:3300/0 conn(0x7fd2840a30c0 0x7fd2840a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840c2870 con 0x7fd2840bea40 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fd280001680 con 0x7fd2840bea40 2023-06-23T18:49:50.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2888da640 1 --2- 172.21.15.38:0/3401308311 >> v2:172.21.15.81:3300/0 conn(0x7fd2840a30c0 0x7fd2840a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 >> v1:172.21.15.38:6789/0 conn(0x7fd2840bea40 legacy=0x7fd28406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd270003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270004d10 0x7fd270005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840bf350 con 0x7fd270003980 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840c22a0 con 0x7fd270004d10 2023-06-23T18:49:50.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27000b990 con 0x7fd2840c0c70 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd270003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2898dc640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270004d10 0x7fd270005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2888da640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 -- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 msgr2=0x7fd2700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c0c70 0x7fd2700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 -- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270004d10 msgr2=0x7fd270005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:50.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270004d10 0x7fd270005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.570+0000 7fd2890db640 1 -- 172.21.15.38:0/3401308311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270003530 con 0x7fd270003980 2023-06-23T18:49:50.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd2890db640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd270003d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c210 tx=0x7fd28001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c517b9701e27b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800058e0 con 0x7fd270003980 2023-06-23T18:49:50.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280005a40 con 0x7fd270003980 2023-06-23T18:49:50.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd27bfff640 1 -- 172.21.15.38:0/3401308311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280005df0 con 0x7fd270003980 2023-06-23T18:49:50.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- 172.21.15.38:0/3401308311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 msgr2=0x7fd270003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 --2- 172.21.15.38:0/3401308311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd270003d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c210 tx=0x7fd28001cc10 comp rx=0 tx=0).stop 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd2898dc640 1 -- 172.21.15.38:0/3401308311 reap_dead start 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- 172.21.15.38:0/3401308311 shutdown_connections 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- 172.21.15.38:0/3401308311 >> 172.21.15.38:0/3401308311 conn(0x7fd2840a5cc0 msgr2=0x7fd2840a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- 172.21.15.38:0/3401308311 shutdown_connections 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- 172.21.15.38:0/3401308311 wait complete. 2023-06-23T18:49:50.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 Processor -- start 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.574+0000 7fd28b33f640 1 -- start start 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840b72a0 0x7fd2840c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 0x7fd2841e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841e9af0 con 0x7fd270003980 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840b8a20 con 0x7fd2840b72a0 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841e9710 con 0x7fd2840c45c0 2023-06-23T18:49:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43036/0 (socket says 172.21.15.38:43036) 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 -- 172.21.15.38:0/2948466774 learned_addr learned my addr 172.21.15.38:0/2948466774 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2888da640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840b72a0 0x7fd2840c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2898dc640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 0x7fd2841e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 -- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 msgr2=0x7fd2841e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 0x7fd2841e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 -- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840b72a0 msgr2=0x7fd2840c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840b72a0 0x7fd2840c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 -- 172.21.15.38:0/2948466774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2841ea450 con 0x7fd270003980 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2898dc640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 0x7fd2841e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd2890db640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2800ab040 tx=0x7fd270005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800a5800 con 0x7fd270003980 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2800a5960 con 0x7fd270003980 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800a5d10 con 0x7fd270003980 2023-06-23T18:49:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2840b8610 con 0x7fd270003980 2023-06-23T18:49:50.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841e6700 con 0x7fd270003980 2023-06-23T18:49:50.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2841e9d60 con 0x7fd270003980 2023-06-23T18:49:50.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2800047f0 con 0x7fd270003980 2023-06-23T18:49:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 0x7fd268068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.578+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd28011de20 con 0x7fd270003980 2023-06-23T18:49:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.582+0000 7fd2888da640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 0x7fd268068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.582+0000 7fd2888da640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 0x7fd268068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2840b7670 tx=0x7fd274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.582+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2800eb120 con 0x7fd270003980 2023-06-23T18:49:50.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.742+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2841e9850 con 0x7fd270003980 2023-06-23T18:49:50.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd279ffb640 1 -- 172.21.15.38:0/2948466774 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2841e9850 con 0x7fd270003980 2023-06-23T18:49:50.754 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:49:50.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 msgr2=0x7fd268068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 0x7fd268068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2840b7670 tx=0x7fd274008040 comp rx=0 tx=0).stop 2023-06-23T18:49:50.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 msgr2=0x7fd2841e9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:50.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2800ab040 tx=0x7fd270005800 comp rx=0 tx=0).stop 2023-06-23T18:49:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 shutdown_connections 2023-06-23T18:49:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd268066280 0x7fd268068730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd2840c45c0 0x7fd2841e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840b72a0 0x7fd2840c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 --2- 172.21.15.38:0/2948466774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd270003980 0x7fd2841e9f10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:50.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 >> 172.21.15.38:0/2948466774 conn(0x7fd2840a5cc0 msgr2=0x7fd28414bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:50.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 shutdown_connections 2023-06-23T18:49:50.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:50.746+0000 7fd28b33f640 1 -- 172.21.15.38:0/2948466774 wait complete. 2023-06-23T18:49:50.770 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-06-23T18:49:50.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:50.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-23T18:49:50.794 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[32743]: fuse finished with error 0 and tester_r 0 2023-06-23T18:49:50.796 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:49:50.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:49:50.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:49:50.895 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-23T18:49:50.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:51.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 Processor -- start 2023-06-23T18:49:51.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 -- start start 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e9814b930 0x7f0e9806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980ba9d0 con 0x7f0e980bd1e0 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e98071080 con 0x7f0e9806c9b0 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e9d463640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980bc300 con 0x7f0e9814b930 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e967fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0e980bd1e0 0x7f0e98070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58092/0 (socket says 172.21.15.38:58092) 2023-06-23T18:49:51.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e967fc640 1 -- 172.21.15.38:0/2194211370 learned_addr learned my addr 172.21.15.38:0/2194211370 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:51.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/2194211370 >> v2:172.21.15.81:3300/0 conn(0x7f0e9814b930 0x7f0e9806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178014770 0 0) 0x7f0e980ba9d0 con 0x7f0e980bd1e0 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e80003530 con 0x7f0e980bd1e0 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708192609 0 0) 0x7f0e80003530 con 0x7f0e980bd1e0 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 >> v2:172.21.15.81:3300/0 conn(0x7f0e9814b930 msgr2=0x7f0e9806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 --2- 172.21.15.38:0/2194211370 >> v2:172.21.15.81:3300/0 conn(0x7f0e9814b930 0x7f0e9806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 >> v1:172.21.15.81:6789/0 conn(0x7f0e9806c9b0 legacy=0x7f0e98070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98150160 con 0x7f0e980bd1e0 2023-06-23T18:49:51.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f0e8c001680 con 0x7f0e980bd1e0 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 >> v1:172.21.15.38:6789/0 conn(0x7f0e980bd1e0 legacy=0x7f0e98070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 0x7f0e80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e800047d0 0x7f0e80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80005180 0x7f0e8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980bc300 con 0x7f0e80003980 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000c000 con 0x7f0e800047d0 2023-06-23T18:49:51.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000c1c0 con 0x7f0e80005180 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 0x7f0e80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e967fc640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e800047d0 0x7f0e80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e977fe640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80005180 0x7f0e8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 -- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80005180 msgr2=0x7f0e8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80005180 0x7f0e8000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 -- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e800047d0 msgr2=0x7f0e80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e800047d0 0x7f0e80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e96ffd640 1 -- 172.21.15.38:0/2194211370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80003530 con 0x7f0e80003980 2023-06-23T18:49:51.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.030+0000 7f0e977fe640 1 -- 172.21.15.38:0/2194211370 reap_dead start 2023-06-23T18:49:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 0x7f0e80003d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009ae0 tx=0x7f0e8801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d193dbb33e2dc3da server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880a49a0 con 0x7f0e80003980 2023-06-23T18:49:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880a4b00 con 0x7f0e80003980 2023-06-23T18:49:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e95ffb640 1 -- 172.21.15.38:0/2194211370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880ac440 con 0x7f0e80003980 2023-06-23T18:49:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 msgr2=0x7f0e80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 0x7f0e80003d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009ae0 tx=0x7f0e8801c750 comp rx=0 tx=0).stop 2023-06-23T18:49:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- 172.21.15.38:0/2194211370 shutdown_connections 2023-06-23T18:49:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 --2- 172.21.15.38:0/2194211370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e80003980 0x7f0e80003d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- 172.21.15.38:0/2194211370 >> 172.21.15.38:0/2194211370 conn(0x7f0e980c0c90 msgr2=0x7f0e980bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- 172.21.15.38:0/2194211370 shutdown_connections 2023-06-23T18:49:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- 172.21.15.38:0/2194211370 wait complete. 2023-06-23T18:49:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 Processor -- start 2023-06-23T18:49:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- start start 2023-06-23T18:49:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80003980 0x7f0e98146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e981d9240 0x7f0e98147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980a5570 con 0x7f0e98147f80 2023-06-23T18:49:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981ea0a0 con 0x7f0e981d9240 2023-06-23T18:49:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e9d463640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981dbb80 con 0x7f0e80003980 2023-06-23T18:49:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43048/0 (socket says 172.21.15.38:43048) 2023-06-23T18:49:51.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e977fe640 1 -- 172.21.15.38:0/1844206206 learned_addr learned my addr 172.21.15.38:0/1844206206 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:51.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e967fc640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e981d9240 0x7f0e98147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.034+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80003980 0x7f0e98146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 -- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80003980 msgr2=0x7f0e98146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80003980 0x7f0e98146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 -- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e981d9240 msgr2=0x7f0e98147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e981d9240 0x7f0e98147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 -- 172.21.15.38:0/1844206206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e981db5c0 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e977fe640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ba880 tx=0x7f0e9000d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000b070 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90003980 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003d10 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e981db8a0 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e981d9f90 con 0x7f0e98147f80 2023-06-23T18:49:51.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e981ea3c0 con 0x7f0e98147f80 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e900050d0 con 0x7f0e98147f80 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 0x7f0e84068750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e90082d50 con 0x7f0e98147f80 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 0x7f0e84068750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.038+0000 7f0e96ffd640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 0x7f0e84068750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e880ae000 tx=0x7f0e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.042+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e981ea3c0 con 0x7f0e98147f80 2023-06-23T18:49:51.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.190+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e981ea3c0 con 0x7f0e98147f80 2023-06-23T18:49:51.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.194+0000 7f0e7f7fe640 1 -- 172.21.15.38:0/1844206206 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f0e981ea3c0 con 0x7f0e98147f80 2023-06-23T18:49:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:51.204 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:51.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 msgr2=0x7f0e84068750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 0x7f0e84068750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e880ae000 tx=0x7f0e88008040 comp rx=0 tx=0).stop 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 msgr2=0x7f0e981da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ba880 tx=0x7f0e9000d830 comp rx=0 tx=0).stop 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 shutdown_connections 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e840662a0 0x7f0e84068750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98147f80 0x7f0e981da4c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e981d9240 0x7f0e98147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 --2- 172.21.15.38:0/1844206206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e80003980 0x7f0e98146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 >> 172.21.15.38:0/1844206206 conn(0x7f0e980c0c90 msgr2=0x7f0e9814cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:51.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 shutdown_connections 2023-06-23T18:49:51.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.198+0000 7f0e9d463640 1 -- 172.21.15.38:0/1844206206 wait complete. 2023-06-23T18:49:51.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.334+0000 7fa23ae31640 1 Processor -- start 2023-06-23T18:49:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.334+0000 7fa23ae31640 1 -- start start 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa23ae31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa23406c6d0 0x7fa234070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa23ae31640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa23ae31640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2340b9ca0 con 0x7fa2340bd9b0 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa23ae31640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340a55b0 con 0x7fa23406c6d0 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa23ae31640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340714a0 con 0x7fa2340bc4f0 2023-06-23T18:49:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa2393ce640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa23406c6d0 0x7fa234070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa233fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2340bd9b0 0x7fa2340a4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:45268/0 (socket says 172.21.15.38:45268) 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa2393ce640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:34200/0 (socket says 172.21.15.38:34200) 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa23406c6d0 0x7fa234070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:35542/0 (socket says 172.21.15.38:35542) 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa233fff640 1 -- 172.21.15.38:0/3704807067 learned_addr learned my addr 172.21.15.38:0/3704807067 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 -- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 msgr2=0x7fa23414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 -- 172.21.15.38:0/3704807067 >> v1:172.21.15.81:6789/0 conn(0x7fa2340bd9b0 legacy=0x7fa2340a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 -- 172.21.15.38:0/3704807067 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23406a3f0 con 0x7fa23406c6d0 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa2393ce640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.338+0000 7fa238bcd640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa23406c6d0 0x7fa234070f60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097c0 tx=0x7fa22401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2dff9043143879 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa2337fe640 1 -- 172.21.15.38:0/3704807067 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240ab5f0 con 0x7fa23406c6d0 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa2337fe640 1 -- 172.21.15.38:0/3704807067 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2240ab750 con 0x7fa23406c6d0 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa2337fe640 1 -- 172.21.15.38:0/3704807067 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240abae0 con 0x7fa23406c6d0 2023-06-23T18:49:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa23406c6d0 msgr2=0x7fa234070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa23406c6d0 0x7fa234070f60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097c0 tx=0x7fa22401c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- 172.21.15.38:0/3704807067 shutdown_connections 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- 172.21.15.38:0/3704807067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa23406c6d0 0x7fa234070f60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- 172.21.15.38:0/3704807067 >> 172.21.15.38:0/3704807067 conn(0x7fa2340c0c90 msgr2=0x7fa2340bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- 172.21.15.38:0/3704807067 shutdown_connections 2023-06-23T18:49:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- 172.21.15.38:0/3704807067 wait complete. 2023-06-23T18:49:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 Processor -- start 2023-06-23T18:49:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- start start 2023-06-23T18:49:51.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23413a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2340bd9b0 0x7fa23413d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa234144310 con 0x7fa23406c6d0 2023-06-23T18:49:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341467b0 con 0x7fa2340bd9b0 2023-06-23T18:49:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa23ae31640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa234145cd0 con 0x7fa2340bc4f0 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43054/0 (socket says 172.21.15.38:43054) 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 -- 172.21.15.38:0/2714752385 learned_addr learned my addr 172.21.15.38:0/2714752385 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa2393ce640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2340bd9b0 0x7fa23413d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa233fff640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23413a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 -- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 msgr2=0x7fa23413a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23413a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 -- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2340bd9b0 msgr2=0x7fa23413d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2340bd9b0 0x7fa23413d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 -- 172.21.15.38:0/2714752385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c009420 con 0x7fa23406c6d0 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.342+0000 7fa238bcd640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2240ad040 tx=0x7fa22401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240bf610 con 0x7fa23406c6d0 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2240bf770 con 0x7fa23406c6d0 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa224009420 con 0x7fa23406c6d0 2023-06-23T18:49:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240bfb00 con 0x7fa23406c6d0 2023-06-23T18:49:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa234146290 con 0x7fa23406c6d0 2023-06-23T18:49:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.346+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa234146480 con 0x7fa23406c6d0 2023-06-23T18:49:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.350+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2240bfc60 con 0x7fa23406c6d0 2023-06-23T18:49:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.350+0000 7fa2317fa640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 0x7fa218068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.350+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa2240a8050 con 0x7fa23406c6d0 2023-06-23T18:49:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.350+0000 7fa233fff640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 0x7fa218068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.350+0000 7fa233fff640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 0x7fa218068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa23413cfc0 tx=0x7fa22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.362+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2240ebc70 con 0x7fa23406c6d0 2023-06-23T18:49:51.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.510+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa234145e10 con 0x7fa23406c6d0 2023-06-23T18:49:51.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.510+0000 7fa2317fa640 1 -- 172.21.15.38:0/2714752385 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fa234145e10 con 0x7fa23406c6d0 2023-06-23T18:49:51.521 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:51.521 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:51.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 msgr2=0x7fa218068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 0x7fa218068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa23413cfc0 tx=0x7fa22c009040 comp rx=0 tx=0).stop 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 msgr2=0x7fa2340bf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2240ad040 tx=0x7fa22401ac30 comp rx=0 tx=0).stop 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 shutdown_connections 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa2180662b0 0x7fa218068760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2340bd9b0 0x7fa23413d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2340bc4f0 0x7fa23413a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 --2- 172.21.15.38:0/2714752385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa23406c6d0 0x7fa2340bf6a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 >> 172.21.15.38:0/2714752385 conn(0x7fa2340c0c90 msgr2=0x7fa23413fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:51.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 shutdown_connections 2023-06-23T18:49:51.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.514+0000 7fa23ae31640 1 -- 172.21.15.38:0/2714752385 wait complete. 2023-06-23T18:49:51.538 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T18:49:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.658+0000 7f95f2d67640 1 Processor -- start 2023-06-23T18:49:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.658+0000 7f95f2d67640 1 -- start start 2023-06-23T18:49:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f2d67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95ec0a3850 0x7f95ec0bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f2d67640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec0bf1a0 0x7f95ec151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f2d67640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec0c23a0 con 0x7f95ec0be890 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f2d67640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0c1490 con 0x7f95ec0a3850 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f2d67640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0aa080 con 0x7f95ec0bf1a0 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f95ec0be890 0x7f95ec0c0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58106/0 (socket says 172.21.15.38:58106) 2023-06-23T18:49:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 -- 172.21.15.38:0/1023867779 learned_addr learned my addr 172.21.15.38:0/1023867779 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:51.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95ebfff640 1 --2- 172.21.15.38:0/1023867779 >> v2:172.21.15.81:3300/0 conn(0x7f95ec0a3850 0x7f95ec0bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f1304640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec0bf1a0 0x7f95ec151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340982956 0 0) 0x7f95ec0c23a0 con 0x7f95ec0be890 2023-06-23T18:49:51.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d4003530 con 0x7f95ec0be890 2023-06-23T18:49:51.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2885706786 0 0) 0x7f95d4003530 con 0x7f95ec0be890 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec0bf1a0 msgr2=0x7f95ec151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec0bf1a0 0x7f95ec151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 >> v2:172.21.15.81:3300/0 conn(0x7f95ec0a3850 msgr2=0x7f95ec0bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 --2- 172.21.15.38:0/1023867779 >> v2:172.21.15.81:3300/0 conn(0x7f95ec0a3850 0x7f95ec0bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0bb060 con 0x7f95ec0be890 2023-06-23T18:49:51.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f95e4001a00 con 0x7f95ec0be890 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 >> v1:172.21.15.38:6789/0 conn(0x7f95ec0be890 legacy=0x7f95ec0c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95d40047d0 0x7f95d4004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d4005140 0x7f95d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0aa080 con 0x7f95d4003980 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400bed0 con 0x7f95d4005140 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400c010 con 0x7f95d40047d0 2023-06-23T18:49:51.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95ebfff640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95d40047d0 0x7f95d4004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 -- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95d40047d0 msgr2=0x7f95d4004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95d40047d0 0x7f95d4004c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 -- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d4005140 msgr2=0x7f95d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d4005140 0x7f95d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.662+0000 7f95f0b03640 1 -- 172.21.15.38:0/1023867779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4003530 con 0x7f95d4003980 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95e400a900 tx=0x7f95e401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80b94ee8094a43 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40ad630 con 0x7f95d4003980 2023-06-23T18:49:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40a8070 con 0x7f95d4003980 2023-06-23T18:49:51.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95eb7fe640 1 -- 172.21.15.38:0/1023867779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40ad9d0 con 0x7f95d4003980 2023-06-23T18:49:51.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1023867779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 msgr2=0x7f95d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1023867779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95d4003d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95e400a900 tx=0x7f95e401d3c0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f1304640 1 -- 172.21.15.38:0/1023867779 reap_dead start 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1023867779 shutdown_connections 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1023867779 >> 172.21.15.38:0/1023867779 conn(0x7f95ec0a5d50 msgr2=0x7f95ec0a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1023867779 shutdown_connections 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1023867779 wait complete. 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 Processor -- start 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- start start 2023-06-23T18:49:51.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec14afb0 0x7f95ec149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 0x7f95ec0bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0bd2f0 con 0x7f95d4003980 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0a5740 con 0x7f95ec14a530 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec1529f0 con 0x7f95ec14afb0 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43080/0 (socket says 172.21.15.38:43080) 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 -- 172.21.15.38:0/1652686483 learned_addr learned my addr 172.21.15.38:0/1652686483 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f1304640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 0x7f95ec0bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95ebfff640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec14afb0 0x7f95ec149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 -- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec14afb0 msgr2=0x7f95ec149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec14afb0 0x7f95ec149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 -- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 msgr2=0x7f95ec0bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 0x7f95ec0bd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:51.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 -- 172.21.15.38:0/1652686483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec152cd0 con 0x7f95d4003980 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f1304640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 0x7f95ec0bd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f0b03640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f95e400a900 tx=0x7f95d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40ad430 con 0x7f95d4003980 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e40ad590 con 0x7f95d4003980 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec14ac80 con 0x7f95d4003980 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40ad9b0 con 0x7f95d4003980 2023-06-23T18:49:51.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.666+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec14b420 con 0x7f95d4003980 2023-06-23T18:49:51.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec153040 con 0x7f95d4003980 2023-06-23T18:49:51.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95e40aa030 con 0x7f95d4003980 2023-06-23T18:49:51.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95e97fa640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 0x7f95d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:51.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95e411dfa0 con 0x7f95d4003980 2023-06-23T18:49:51.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95ebfff640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 0x7f95d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:51.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.670+0000 7f95ebfff640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 0x7f95d8068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098d0 tx=0x7f95e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:51.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.674+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95e40eb120 con 0x7f95d4003980 2023-06-23T18:49:51.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:51.854+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f95ec04d790 con 0x7f95d4003980 2023-06-23T18:49:52.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.370+0000 7f95e97fa640 1 -- 172.21.15.38:0/1652686483 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f95e40ee740 con 0x7f95d4003980 2023-06-23T18:49:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 msgr2=0x7f95d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 0x7f95d8068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098d0 tx=0x7f95e0008040 comp rx=0 tx=0).stop 2023-06-23T18:49:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 msgr2=0x7f95ec0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f95e400a900 tx=0x7f95d4005800 comp rx=0 tx=0).stop 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 shutdown_connections 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f95d80662b0 0x7f95d8068760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95ec14a530 0x7f95ec0bd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95ec14afb0 0x7f95ec149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 --2- 172.21.15.38:0/1652686483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95d4003980 0x7f95ec0a5200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 >> 172.21.15.38:0/1652686483 conn(0x7f95ec0a5d50 msgr2=0x7f95ec0c1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 shutdown_connections 2023-06-23T18:49:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.374+0000 7f95f2d67640 1 -- 172.21.15.38:0/1652686483 wait complete. 2023-06-23T18:49:52.403 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-23T18:49:52.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T18:49:52.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 Processor -- start 2023-06-23T18:49:52.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 -- start start 2023-06-23T18:49:52.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcefc149c90 0x7fcefc0ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc14b760 con 0x7fcefc06f7f0 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0b9ea0 con 0x7fcefc071010 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcf01be6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0ba180 con 0x7fcefc149c90 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcefc149c90 0x7fcefc0ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefaffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcefc06f7f0 0x7fcefc14b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58108/0 (socket says 172.21.15.38:58108) 2023-06-23T18:49:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefaffd640 1 -- 172.21.15.38:0/3092847276 learned_addr learned my addr 172.21.15.38:0/3092847276 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefb7fe640 1 -- 172.21.15.38:0/3092847276 >> v1:172.21.15.81:6789/0 conn(0x7fcefc071010 legacy=0x7fcefc14db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefb7fe640 1 -- 172.21.15.38:0/3092847276 >> v1:172.21.15.38:6789/0 conn(0x7fcefc06f7f0 legacy=0x7fcefc14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefa7fc640 1 -- 172.21.15.38:0/3092847276 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518257373 0 0) 0x7fcefc14b760 con 0x7fcefc06f7f0 2023-06-23T18:49:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.534+0000 7fcefb7fe640 1 -- 172.21.15.38:0/3092847276 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc14e980 con 0x7fcefc149c90 2023-06-23T18:49:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefb7fe640 1 --2- 172.21.15.38:0/3092847276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc0ba7f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a960 tx=0x7fceec01d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc22b9376708718 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefa7fc640 1 -- 172.21.15.38:0/3092847276 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a6900 con 0x7fcefc149c90 2023-06-23T18:49:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefa7fc640 1 -- 172.21.15.38:0/3092847276 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0a6a60 con 0x7fcefc149c90 2023-06-23T18:49:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefa7fc640 1 -- 172.21.15.38:0/3092847276 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a6df0 con 0x7fcefc149c90 2023-06-23T18:49:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- 172.21.15.38:0/3092847276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 msgr2=0x7fcefc0ba7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3092847276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc0ba7f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a960 tx=0x7fceec01d810 comp rx=0 tx=0).stop 2023-06-23T18:49:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- 172.21.15.38:0/3092847276 shutdown_connections 2023-06-23T18:49:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3092847276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc0ba7f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- 172.21.15.38:0/3092847276 >> 172.21.15.38:0/3092847276 conn(0x7fcefc0bfe30 msgr2=0x7fcefc0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- 172.21.15.38:0/3092847276 shutdown_connections 2023-06-23T18:49:52.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- 172.21.15.38:0/3092847276 wait complete. 2023-06-23T18:49:52.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 Processor -- start 2023-06-23T18:49:52.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- start start 2023-06-23T18:49:52.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcefc06f7f0 0x7fcefc139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 0x7fcefc0becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc13b160 con 0x7fcefc149c90 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc13ade0 con 0x7fcefc06f7f0 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcf01be6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc141760 con 0x7fcefc071010 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43092/0 (socket says 172.21.15.38:43092) 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 -- 172.21.15.38:0/3038146036 learned_addr learned my addr 172.21.15.38:0/3038146036 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefb7fe640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcefc06f7f0 0x7fcefc139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefaffd640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 0x7fcefc0becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 -- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 msgr2=0x7fcefc0becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 0x7fcefc0becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 -- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcefc06f7f0 msgr2=0x7fcefc139440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcefc06f7f0 0x7fcefc139440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 -- 172.21.15.38:0/3038146036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec00a5c0 con 0x7fcefc149c90 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefaffd640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 0x7fcefc0becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.538+0000 7fcefbfff640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c7e0 tx=0x7fcef400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4003d90 con 0x7fcefc149c90 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4005070 con 0x7fcefc149c90 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4005420 con 0x7fcefc149c90 2023-06-23T18:49:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc13a820 con 0x7fcefc149c90 2023-06-23T18:49:52.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc1414c0 con 0x7fcefc149c90 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc1418f0 con 0x7fcefc149c90 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcef4005580 con 0x7fcefc149c90 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 0x7fcedc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcef40834d0 con 0x7fcefc149c90 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcefb7fe640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 0x7fcedc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.542+0000 7fcefb7fe640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 0x7fcedc068760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b0000 tx=0x7fceec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.546+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcef40505e0 con 0x7fcefc149c90 2023-06-23T18:49:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:52.734+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcefc0bf200 con 0x7fcefc149c90 2023-06-23T18:49:53.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:53.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:53.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:53.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:53.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:53.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.390+0000 7fcef3fff640 1 -- 172.21.15.38:0/3038146036 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcef4053c00 con 0x7fcefc149c90 2023-06-23T18:49:53.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 msgr2=0x7fcedc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 0x7fcedc068760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b0000 tx=0x7fceec008040 comp rx=0 tx=0).stop 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 msgr2=0x7fcefc1372e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c7e0 tx=0x7fcef400cca0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 shutdown_connections 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcedc0662b0 0x7fcedc068760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcefc149c90 0x7fcefc1372e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcefc071010 0x7fcefc0becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 --2- 172.21.15.38:0/3038146036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcefc06f7f0 0x7fcefc139440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 >> 172.21.15.38:0/3038146036 conn(0x7fcefc0bfe30 msgr2=0x7fcefc146840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:53.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 shutdown_connections 2023-06-23T18:49:53.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.394+0000 7fcf01be6640 1 -- 172.21.15.38:0/3038146036 wait complete. 2023-06-23T18:49:53.422 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-23T18:49:53.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:49:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.546+0000 7f8f2e43b640 1 Processor -- start 2023-06-23T18:49:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.546+0000 7f8f2e43b640 1 -- start start 2023-06-23T18:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2e43b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8f280bea40 0x7f8f280a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2e43b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f28152830 con 0x7f8f280c0c70 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2e43b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f280c22a0 con 0x7f8f280a30c0 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2e43b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2806aeb0 con 0x7f8f280bea40 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2c9d8640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8f280c0c70 0x7f8f2806a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58124/0 (socket says 172.21.15.38:58124) 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2c9d8640 1 -- 172.21.15.38:0/902429480 learned_addr learned my addr 172.21.15.38:0/902429480 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 --2- 172.21.15.38:0/902429480 >> v2:172.21.15.81:3300/0 conn(0x7f8f280bea40 0x7f8f280a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763607298 0 0) 0x7f8f28152830 con 0x7f8f280c0c70 2023-06-23T18:49:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f14003530 con 0x7f8f280c0c70 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869389823 0 0) 0x7f8f14003530 con 0x7f8f280c0c70 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 >> v2:172.21.15.81:3300/0 conn(0x7f8f280bea40 msgr2=0x7f8f280a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 --2- 172.21.15.38:0/902429480 >> v2:172.21.15.81:3300/0 conn(0x7f8f280bea40 0x7f8f280a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 >> v1:172.21.15.81:6789/0 conn(0x7f8f280a30c0 legacy=0x7f8f2806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f280c2870 con 0x7f8f280c0c70 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f8f18001680 con 0x7f8f280c0c70 2023-06-23T18:49:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 >> v1:172.21.15.38:6789/0 conn(0x7f8f280c0c70 legacy=0x7f8f2806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f140047d0 0x7f8f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f14005180 0x7f8f1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2806aeb0 con 0x7f8f14003980 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1400c090 con 0x7f8f14005180 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1400c250 con 0x7f8f140047d0 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2c9d8640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f14005180 0x7f8f1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f277fe640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f140047d0 0x7f8f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 -- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f140047d0 msgr2=0x7f8f14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f140047d0 0x7f8f14004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 -- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f14005180 msgr2=0x7f8f1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f14005180 0x7f8f1400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f27fff640 1 -- 172.21.15.38:0/902429480 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14003530 con 0x7f8f14003980 2023-06-23T18:49:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2c9d8640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f14005180 0x7f8f1400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.550+0000 7f8f2c9d8640 1 -- 172.21.15.38:0/902429480 reap_dead start 2023-06-23T18:49:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f14003d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009fc0 tx=0x7f8f2001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28569e5dfc51963 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200a5b30 con 0x7f8f14003980 2023-06-23T18:49:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000f040 con 0x7f8f14003980 2023-06-23T18:49:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f26ffd640 1 -- 172.21.15.38:0/902429480 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200ad440 con 0x7f8f14003980 2023-06-23T18:49:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 msgr2=0x7f8f14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f14003d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009fc0 tx=0x7f8f2001cc30 comp rx=0 tx=0).stop 2023-06-23T18:49:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/902429480 shutdown_connections 2023-06-23T18:49:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/902429480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f14003d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/902429480 >> 172.21.15.38:0/902429480 conn(0x7f8f280a5cc0 msgr2=0x7f8f280a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:53.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/902429480 shutdown_connections 2023-06-23T18:49:53.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/902429480 wait complete. 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 Processor -- start 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- start start 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f2814c980 0x7f8f281e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f281e7820 0x7f8f2814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280ba230 con 0x7f8f14003980 2023-06-23T18:49:53.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28149760 con 0x7f8f2814c980 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f281492a0 con 0x7f8f281e7820 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43114/0 (socket says 172.21.15.38:43114) 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 -- 172.21.15.38:0/3183613692 learned_addr learned my addr 172.21.15.38:0/3183613692 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f277fe640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f2814c980 0x7f8f281e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2c9d8640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f281e7820 0x7f8f2814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 -- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f281e7820 msgr2=0x7f8f2814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f281e7820 0x7f8f2814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 -- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f2814c980 msgr2=0x7f8f281e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f2814c980 0x7f8f281e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 -- 172.21.15.38:0/3183613692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2814c4f0 con 0x7f8f14003980 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f27fff640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0040 tx=0x7f8f20009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20003ba0 con 0x7f8f14003980 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f20003d00 con 0x7f8f14003980 2023-06-23T18:49:53.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f281e9610 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20004240 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.554+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f281e7370 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f28149110 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f200b4040 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f24ff9640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 0x7f8f08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f2011e6c0 con 0x7f8f14003980 2023-06-23T18:49:53.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f277fe640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 0x7f8f08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.558+0000 7f8f277fe640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 0x7f8f08068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f2814cd50 tx=0x7f8f10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.562+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f200eba10 con 0x7f8f14003980 2023-06-23T18:49:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.750+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f28149920 con 0x7f8f14003980 2023-06-23T18:49:53.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.750+0000 7f8f24ff9640 1 -- 172.21.15.38:0/3183613692 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7f8f200ef030 con 0x7f8f14003980 2023-06-23T18:49:53.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:53.756 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:49:53.756 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 msgr2=0x7f8f08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 0x7f8f08068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f2814cd50 tx=0x7f8f10009040 comp rx=0 tx=0).stop 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 msgr2=0x7f8f281e90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0040 tx=0x7f8f20009750 comp rx=0 tx=0).stop 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 shutdown_connections 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8f080662b0 0x7f8f08068760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8f281e7820 0x7f8f2814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f2814c980 0x7f8f281e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 --2- 172.21.15.38:0/3183613692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f14003980 0x7f8f281e90d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 >> 172.21.15.38:0/3183613692 conn(0x7f8f280a5cc0 msgr2=0x7f8f28149f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:53.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 shutdown_connections 2023-06-23T18:49:53.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.754+0000 7f8f2e43b640 1 -- 172.21.15.38:0/3183613692 wait complete. 2023-06-23T18:49:53.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:53.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 Processor -- start 2023-06-23T18:49:53.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 -- start start 2023-06-23T18:49:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29bc06e6a0 0x7f29bc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc06eb80 con 0x7f29bc1371a0 2023-06-23T18:49:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc152130 con 0x7f29bc0702a0 2023-06-23T18:49:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c3c81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc152410 con 0x7f29bc06e6a0 2023-06-23T18:49:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c221e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f29bc1371a0 0x7f29bc06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58128/0 (socket says 172.21.15.38:58128) 2023-06-23T18:49:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c221e640 1 -- 172.21.15.38:0/2255540260 learned_addr learned my addr 172.21.15.38:0/2255540260 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c121c640 1 --2- 172.21.15.38:0/2255540260 >> v2:172.21.15.81:3300/0 conn(0x7f29bc06e6a0 0x7f29bc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c0a1b640 1 -- 172.21.15.38:0/2255540260 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863818082 0 0) 0x7f29bc06eb80 con 0x7f29bc1371a0 2023-06-23T18:49:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c0a1b640 1 -- 172.21.15.38:0/2255540260 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a4003530 con 0x7f29bc1371a0 2023-06-23T18:49:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c121c640 1 -- 172.21.15.38:0/2255540260 >> v1:172.21.15.81:6789/0 conn(0x7f29bc0702a0 legacy=0x7f29bc133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c121c640 1 -- 172.21.15.38:0/2255540260 >> v1:172.21.15.38:6789/0 conn(0x7f29bc1371a0 legacy=0x7f29bc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.890+0000 7f29c121c640 1 -- 172.21.15.38:0/2255540260 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc136e70 con 0x7f29bc06e6a0 2023-06-23T18:49:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c121c640 1 --2- 172.21.15.38:0/2255540260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc06e6a0 0x7f29bc070eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29b00097c0 tx=0x7f29b001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570c5b71fc5f24d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c0a1b640 1 -- 172.21.15.38:0/2255540260 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00ab600 con 0x7f29bc06e6a0 2023-06-23T18:49:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c0a1b640 1 -- 172.21.15.38:0/2255540260 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b00a7050 con 0x7f29bc06e6a0 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c0a1b640 1 -- 172.21.15.38:0/2255540260 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00ab960 con 0x7f29bc06e6a0 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- 172.21.15.38:0/2255540260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc06e6a0 msgr2=0x7f29bc070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 --2- 172.21.15.38:0/2255540260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc06e6a0 0x7f29bc070eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29b00097c0 tx=0x7f29b001c480 comp rx=0 tx=0).stop 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- 172.21.15.38:0/2255540260 shutdown_connections 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 --2- 172.21.15.38:0/2255540260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc06e6a0 0x7f29bc070eb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- 172.21.15.38:0/2255540260 >> 172.21.15.38:0/2255540260 conn(0x7f29bc0c1f90 msgr2=0x7f29bc0c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:53.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- 172.21.15.38:0/2255540260 shutdown_connections 2023-06-23T18:49:53.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- 172.21.15.38:0/2255540260 wait complete. 2023-06-23T18:49:53.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 Processor -- start 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.894+0000 7f29c3c81640 1 -- start start 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29bc06e6a0 0x7f29bc14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 0x7f29bc1ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1e7340 con 0x7f29bc0702a0 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1e7590 con 0x7f29bc1371a0 2023-06-23T18:49:53.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1e7870 con 0x7f29bc06e6a0 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43126/0 (socket says 172.21.15.38:43126) 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 -- 172.21.15.38:0/746330208 learned_addr learned my addr 172.21.15.38:0/746330208 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c221e640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 0x7f29bc1ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c1a1d640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29bc06e6a0 0x7f29bc14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 -- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29bc06e6a0 msgr2=0x7f29bc14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29bc06e6a0 0x7f29bc14f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 -- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 msgr2=0x7f29bc1ea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 0x7f29bc1ea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 -- 172.21.15.38:0/746330208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0009420 con 0x7f29bc0702a0 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c221e640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 0x7f29bc1ea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c121c640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29b001a0b0 tx=0x7f29b0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0006e20 con 0x7f29bc0702a0 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0004020 con 0x7f29bc0702a0 2023-06-23T18:49:53.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc14d560 con 0x7f29bc0702a0 2023-06-23T18:49:53.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0004390 con 0x7f29bc0702a0 2023-06-23T18:49:53.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc1ea7a0 con 0x7f29bc0702a0 2023-06-23T18:49:53.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc1e7a40 con 0x7f29bc0702a0 2023-06-23T18:49:53.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29b00b2040 con 0x7f29bc0702a0 2023-06-23T18:49:53.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 0x7f29a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:53.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29b011de20 con 0x7f29bc0702a0 2023-06-23T18:49:53.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.898+0000 7f29c1a1d640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 0x7f29a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:53.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.902+0000 7f29c1a1d640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 0x7f29a8068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007fd0 tx=0x7f29ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:53.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:53.902+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29bc1e7a40 con 0x7f29bc0702a0 2023-06-23T18:49:54.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.058+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29bc1e7a40 con 0x7f29bc0702a0 2023-06-23T18:49:54.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29ba7fc640 1 -- 172.21.15.38:0/746330208 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f29bc1e7a40 con 0x7f29bc0702a0 2023-06-23T18:49:54.066 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:54.066 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 msgr2=0x7f29a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 0x7f29a8068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29ac007fd0 tx=0x7f29ac009040 comp rx=0 tx=0).stop 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 msgr2=0x7f29bc14f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29b001a0b0 tx=0x7f29b0019220 comp rx=0 tx=0).stop 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 shutdown_connections 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f29a80662b0 0x7f29a8068760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29bc1371a0 0x7f29bc1ea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29bc0702a0 0x7f29bc14f9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 --2- 172.21.15.38:0/746330208 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29bc06e6a0 0x7f29bc14f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 >> 172.21.15.38:0/746330208 conn(0x7f29bc0c1f90 msgr2=0x7f29bc148c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 shutdown_connections 2023-06-23T18:49:54.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.062+0000 7f29c3c81640 1 -- 172.21.15.38:0/746330208 wait complete. 2023-06-23T18:49:54.085 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-23T18:49:54.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:49:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 Processor -- start 2023-06-23T18:49:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 -- start start 2023-06-23T18:49:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0bea40 0x7faf2c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faf2c0a30c0 0x7faf2c0c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c152830 con 0x7faf2c0bee10 2023-06-23T18:49:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0c22a0 con 0x7faf2c0a30c0 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf30f63640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0c2870 con 0x7faf2c0bea40 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf29d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faf2c0a30c0 0x7faf2c0c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf2ad9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7faf2c0bee10 0x7faf2c06a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58144/0 (socket says 172.21.15.38:58144) 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf2ad9d640 1 -- 172.21.15.38:0/2131652184 learned_addr learned my addr 172.21.15.38:0/2131652184 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf2a59c640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0bea40 0x7faf2c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf2959a640 1 -- 172.21.15.38:0/2131652184 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891452842 0 0) 0x7faf2c152830 con 0x7faf2c0bee10 2023-06-23T18:49:54.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf2959a640 1 -- 172.21.15.38:0/2131652184 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf14003530 con 0x7faf2c0bee10 2023-06-23T18:49:54.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf29d9b640 1 -- 172.21.15.38:0/2131652184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0bea40 msgr2=0x7faf2c0a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:54.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf29d9b640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0bea40 0x7faf2c0a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf29d9b640 1 -- 172.21.15.38:0/2131652184 >> v1:172.21.15.38:6789/0 conn(0x7faf2c0bee10 legacy=0x7faf2c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.202+0000 7faf29d9b640 1 -- 172.21.15.38:0/2131652184 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0b7950 con 0x7faf2c0a30c0 2023-06-23T18:49:54.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf29d9b640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0a30c0 0x7faf2c0c0c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097c0 tx=0x7faf1c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6d09a6b775b08c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2959a640 1 -- 172.21.15.38:0/2131652184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0ab600 con 0x7faf2c0a30c0 2023-06-23T18:49:54.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2959a640 1 -- 172.21.15.38:0/2131652184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0a7050 con 0x7faf2c0a30c0 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2959a640 1 -- 172.21.15.38:0/2131652184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0ab960 con 0x7faf2c0a30c0 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- 172.21.15.38:0/2131652184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0a30c0 msgr2=0x7faf2c0c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0a30c0 0x7faf2c0c0c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097c0 tx=0x7faf1c01c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- 172.21.15.38:0/2131652184 shutdown_connections 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0a30c0 0x7faf2c0c0c70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- 172.21.15.38:0/2131652184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0bea40 0x7faf2c0a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- 172.21.15.38:0/2131652184 >> 172.21.15.38:0/2131652184 conn(0x7faf2c0a5cc0 msgr2=0x7faf2c0a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- 172.21.15.38:0/2131652184 shutdown_connections 2023-06-23T18:49:54.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- 172.21.15.38:0/2131652184 wait complete. 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 Processor -- start 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- start start 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0a30c0 0x7faf2c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 0x7faf2c0ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0b6e40 con 0x7faf2c0bee10 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a8d50 con 0x7faf2c0bea40 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf30f63640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a5010 con 0x7faf2c0a30c0 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43150/0 (socket says 172.21.15.38:43150) 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 -- 172.21.15.38:0/2216740611 learned_addr learned my addr 172.21.15.38:0/2216740611 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2a59c640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0a30c0 0x7faf2c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf29d9b640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 0x7faf2c0ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 -- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0a30c0 msgr2=0x7faf2c149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0a30c0 0x7faf2c149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 -- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 msgr2=0x7faf2c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 0x7faf2c0ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf2ad9d640 1 -- 172.21.15.38:0/2216740611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009420 con 0x7faf2c0bee10 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.206+0000 7faf29d9b640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 0x7faf2c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf2ad9d640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf2400cb40 tx=0x7faf2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400aca0 con 0x7faf2c0bee10 2023-06-23T18:49:54.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400ae00 con 0x7faf2c0bee10 2023-06-23T18:49:54.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c14a330 con 0x7faf2c0bee10 2023-06-23T18:49:54.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24012620 con 0x7faf2c0bee10 2023-06-23T18:49:54.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c0a7b70 con 0x7faf2c0bee10 2023-06-23T18:49:54.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0a79d0 con 0x7faf2c0bee10 2023-06-23T18:49:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf24007070 con 0x7faf2c0bee10 2023-06-23T18:49:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 0x7faf0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf24084000 con 0x7faf2c0bee10 2023-06-23T18:49:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf2a59c640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 0x7faf0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.210+0000 7faf2a59c640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 0x7faf0c068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf2c14a850 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.214+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf2c0a79d0 con 0x7faf2c0bee10 2023-06-23T18:49:54.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.366+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf2c0c3990 con 0x7faf0c066280 2023-06-23T18:49:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.394+0000 7faf1affd640 1 -- 172.21.15.38:0/2216740611 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367342 (secure 0 0 0) 0x7faf200118e0 con 0x7faf0c066280 2023-06-23T18:49:54.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:49:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 msgr2=0x7faf0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 0x7faf0c068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf2c14a850 tx=0x7faf20008040 comp rx=0 tx=0).stop 2023-06-23T18:49:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 msgr2=0x7faf2c0ba550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf2400cb40 tx=0x7faf2400a060 comp rx=0 tx=0).stop 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 shutdown_connections 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7faf0c066280 0x7faf0c068730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf2c0bee10 0x7faf2c0ba550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf2c0bea40 0x7faf2c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 --2- 172.21.15.38:0/2216740611 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faf2c0a30c0 0x7faf2c149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 >> 172.21.15.38:0/2216740611 conn(0x7faf2c0a5cc0 msgr2=0x7faf2c151690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.398+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 shutdown_connections 2023-06-23T18:49:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.402+0000 7faf30f63640 1 -- 172.21.15.38:0/2216740611 wait complete. 2023-06-23T18:49:54.423 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-06-23T18:49:53.253493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594818,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230400,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744320,"statfs":{"total":773094113280,"available":772858183680,"internally_reserved":0,"allocated":2555904,"data_stored":2158692,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004916"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.513130+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:49:44.513130+0000","last_peered":"2023-06-23T18:49:44.513130+0000","last_clean":"2023-06-23T18:49:44.513130+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:49:44.513130+0000","last_undegraded":"2023-06-23T18:49:44.513130+0000","last_fullsized":"2023-06-23T18:49:44.513130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4450,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":124888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":124784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:49:54.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:49:54.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.574+0000 7fbc057ab640 1 Processor -- start 2023-06-23T18:49:54.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbc057ab640 1 -- start start 2023-06-23T18:49:54.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbc057ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc0006a630 0x7fbc0014caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbc057ab640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc000ba9d0 con 0x7fbc000bd1e0 2023-06-23T18:49:54.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbc057ab640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc00150160 con 0x7fbc0014b930 2023-06-23T18:49:54.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbc057ab640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc000bc300 con 0x7fbc0006a630 2023-06-23T18:49:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbff7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc0006a630 0x7fbc0014caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbfe7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbc000bd1e0 0x7fbc0014c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58158/0 (socket says 172.21.15.38:58158) 2023-06-23T18:49:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbfe7fc640 1 -- 172.21.15.38:0/3451959529 learned_addr learned my addr 172.21.15.38:0/3451959529 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbff7fe640 1 -- 172.21.15.38:0/3451959529 >> v1:172.21.15.81:6789/0 conn(0x7fbc0014b930 legacy=0x7fbc0006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbff7fe640 1 -- 172.21.15.38:0/3451959529 >> v1:172.21.15.38:6789/0 conn(0x7fbc000bd1e0 legacy=0x7fbc0014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbff7fe640 1 -- 172.21.15.38:0/3451959529 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00150440 con 0x7fbc0006a630 2023-06-23T18:49:54.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbff7fe640 1 --2- 172.21.15.38:0/3451959529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0014caa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009d90 tx=0x7fbbf801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c34a6ca58b6bf9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbfdffb640 1 -- 172.21.15.38:0/3451959529 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80a57d0 con 0x7fbc0006a630 2023-06-23T18:49:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbfdffb640 1 -- 172.21.15.38:0/3451959529 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf80a5930 con 0x7fbc0006a630 2023-06-23T18:49:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.578+0000 7fbbfdffb640 1 -- 172.21.15.38:0/3451959529 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80a5cc0 con 0x7fbc0006a630 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3451959529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 msgr2=0x7fbc0014caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3451959529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0014caa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009d90 tx=0x7fbbf801c910 comp rx=0 tx=0).stop 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3451959529 shutdown_connections 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3451959529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0014caa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3451959529 >> 172.21.15.38:0/3451959529 conn(0x7fbc000c0c90 msgr2=0x7fbc000bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3451959529 shutdown_connections 2023-06-23T18:49:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3451959529 wait complete. 2023-06-23T18:49:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 Processor -- start 2023-06-23T18:49:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- start start 2023-06-23T18:49:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc000bd1e0 0x7fbc001e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 0x7fbc001409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc000a5570 con 0x7fbc0006a630 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001414c0 con 0x7fbc0014b930 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001416a0 con 0x7fbc000bd1e0 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43170/0 (socket says 172.21.15.38:43170) 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 -- 172.21.15.38:0/3967356169 learned_addr learned my addr 172.21.15.38:0/3967356169 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbff7fe640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 0x7fbc001409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 -- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc000bd1e0 msgr2=0x7fbc001e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc000bd1e0 0x7fbc001e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 -- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 msgr2=0x7fbc001409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 0x7fbc001409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 -- 172.21.15.38:0/3967356169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009a70 con 0x7fbc0006a630 2023-06-23T18:49:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbff7fe640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 0x7fbc001409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbfeffd640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000b440 tx=0x7fbbf000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0011890 con 0x7fbc0006a630 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf00119f0 con 0x7fbc0006a630 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc001ea390 con 0x7fbc0006a630 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0011da0 con 0x7fbc0006a630 2023-06-23T18:49:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.582+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc001e9fa0 con 0x7fbc0006a630 2023-06-23T18:49:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc001ea5d0 con 0x7fbc0006a630 2023-06-23T18:49:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbf0004020 con 0x7fbc0006a630 2023-06-23T18:49:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbbe77fe640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 0x7fbbec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbbf0084020 con 0x7fbc0006a630 2023-06-23T18:49:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbbfe7fc640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 0x7fbbec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.586+0000 7fbbfe7fc640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 0x7fbbec068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc0006a160 tx=0x7fbbf4007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.590+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbf0051190 con 0x7fbc0006a630 2023-06-23T18:49:54.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.738+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc001ea220 con 0x7fbbec066280 2023-06-23T18:49:54.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.766+0000 7fbbe77fe640 1 -- 172.21.15.38:0/3967356169 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367342 (secure 0 0 0) 0x7fbc001ea220 con 0x7fbbec066280 2023-06-23T18:49:54.772 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:54.774 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:49:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 msgr2=0x7fbbec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 0x7fbbec068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc0006a160 tx=0x7fbbf4007a50 comp rx=0 tx=0).stop 2023-06-23T18:49:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 msgr2=0x7fbc0006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000b440 tx=0x7fbbf000b900 comp rx=0 tx=0).stop 2023-06-23T18:49:54.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 shutdown_connections 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbbec066280 0x7fbbec068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0014b930 0x7fbc001409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc000bd1e0 0x7fbc001e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 --2- 172.21.15.38:0/3967356169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc0006a630 0x7fbc0006e260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 >> 172.21.15.38:0/3967356169 conn(0x7fbc000c0c90 msgr2=0x7fbc0014ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 shutdown_connections 2023-06-23T18:49:54.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.770+0000 7fbc057ab640 1 -- 172.21.15.38:0/3967356169 wait complete. 2023-06-23T18:49:54.791 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-06-23T18:49:53.253493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594818,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230400,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744320,"statfs":{"total":773094113280,"available":772858183680,"internally_reserved":0,"allocated":2555904,"data_stored":2158692,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004916"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.513130+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:49:44.513130+0000","last_peered":"2023-06-23T18:49:44.513130+0000","last_clean":"2023-06-23T18:49:44.513130+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:49:44.513130+0000","last_undegraded":"2023-06-23T18:49:44.513130+0000","last_fullsized":"2023-06-23T18:49:44.513130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4450,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":124888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":124784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:49:54.799 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-23T18:49:54.800 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-23T18:49:54.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-23T18:49:54.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-23T18:49:54.801 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-23T18:49:54.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 Processor -- start 2023-06-23T18:49:54.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 -- start start 2023-06-23T18:49:54.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b8014b930 0x7f6b8006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800ba9d0 con 0x7f6b800bd1e0 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800bc300 con 0x7f6b8014b930 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b86fa9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800a5570 con 0x7f6b8006c9b0 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b85546640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b84d45640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b8014b930 0x7f6b8006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b85546640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:34286/0 (socket says 172.21.15.38:34286) 2023-06-23T18:49:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b85546640 1 -- 172.21.15.38:0/3446312832 learned_addr learned my addr 172.21.15.38:0/3446312832 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b7ffff640 1 --1- 172.21.15.38:0/3446312832 >> v1:172.21.15.81:6789/0 conn(0x7f6b800bd1e0 0x7f6b80070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:45318/0 (socket says 172.21.15.38:45318) 2023-06-23T18:49:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b84d45640 1 -- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 msgr2=0x7f6b80070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b84d45640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b84d45640 1 -- 172.21.15.38:0/3446312832 >> v1:172.21.15.81:6789/0 conn(0x7f6b800bd1e0 legacy=0x7f6b80070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b84d45640 1 -- 172.21.15.38:0/3446312832 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80150160 con 0x7f6b8014b930 2023-06-23T18:49:54.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.950+0000 7f6b85546640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b84d45640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b8006c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097c0 tx=0x7f6b7001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcca38688d54d832 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b7f7fe640 1 -- 172.21.15.38:0/3446312832 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700ab610 con 0x7f6b8014b930 2023-06-23T18:49:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b7f7fe640 1 -- 172.21.15.38:0/3446312832 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b700ab770 con 0x7f6b8014b930 2023-06-23T18:49:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b7f7fe640 1 -- 172.21.15.38:0/3446312832 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700abb00 con 0x7f6b8014b930 2023-06-23T18:49:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 msgr2=0x7f6b8006c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b8006c470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b700097c0 tx=0x7f6b7001c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- 172.21.15.38:0/3446312832 shutdown_connections 2023-06-23T18:49:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b80070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/3446312832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b8006c470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- 172.21.15.38:0/3446312832 >> 172.21.15.38:0/3446312832 conn(0x7f6b800c0c90 msgr2=0x7f6b800bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- 172.21.15.38:0/3446312832 shutdown_connections 2023-06-23T18:49:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- 172.21.15.38:0/3446312832 wait complete. 2023-06-23T18:49:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 Processor -- start 2023-06-23T18:49:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- start start 2023-06-23T18:49:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b8013f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b801e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80145c10 con 0x7f6b800bd1e0 2023-06-23T18:49:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80148fb0 con 0x7f6b8014b930 2023-06-23T18:49:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.954+0000 7f6b86fa9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80145780 con 0x7f6b8006c9b0 2023-06-23T18:49:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43180/0 (socket says 172.21.15.38:43180) 2023-06-23T18:49:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 -- 172.21.15.38:0/589710796 learned_addr learned my addr 172.21.15.38:0/589710796 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b84d45640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b8013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b85546640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b801e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 -- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 msgr2=0x7f6b8013f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b8013f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 -- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 msgr2=0x7f6b801e40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b801e40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 -- 172.21.15.38:0/589710796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009b30 con 0x7f6b800bd1e0 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b84d45640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b8013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b85546640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b801e40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7ffff640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c450 tx=0x7f6b7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74007480 con 0x7f6b800bd1e0 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740075e0 con 0x7f6b800bd1e0 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b70009420 con 0x7f6b800bd1e0 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004a30 con 0x7f6b800bd1e0 2023-06-23T18:49:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b801453c0 con 0x7f6b800bd1e0 2023-06-23T18:49:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8004d790 con 0x7f6b800bd1e0 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b74004b90 con 0x7f6b800bd1e0 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 0x7f6b6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6b74083330 con 0x7f6b800bd1e0 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.958+0000 7f6b84d45640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 0x7f6b6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.962+0000 7f6b84d45640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 0x7f6b6c068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6b700af000 tx=0x7f6b700a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:54.962+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b74050550 con 0x7f6b800bd1e0 2023-06-23T18:49:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.158+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6b801458c0 con 0x7f6b800bd1e0 2023-06-23T18:49:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.158+0000 7f6b7d7fa640 1 -- 172.21.15.38:0/589710796 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7f6b74053b70 con 0x7f6b800bd1e0 2023-06-23T18:49:55.166 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 msgr2=0x7f6b6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 0x7f6b6c068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6b700af000 tx=0x7f6b700a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 msgr2=0x7f6b80144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c450 tx=0x7f6b7400c910 comp rx=0 tx=0).stop 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 shutdown_connections 2023-06-23T18:49:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b6c066280 0x7f6b6c068730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8014b930 0x7f6b801e40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b800bd1e0 0x7f6b80144760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 --2- 172.21.15.38:0/589710796 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b8006c9b0 0x7f6b8013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 >> 172.21.15.38:0/589710796 conn(0x7f6b800c0c90 msgr2=0x7f6b80149260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 shutdown_connections 2023-06-23T18:49:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.162+0000 7f6b86fa9640 1 -- 172.21.15.38:0/589710796 wait complete. 2023-06-23T18:49:55.185 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3176118993},{"type":"v1","addr":"172.21.15.81:6833","nonce":3176118993}]},"active_addr":"172.21.15.81:6833/3176118993","active_change":"2023-06-23T18:49:17.236882+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2641469636}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3248363095}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1580713553}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1825254622}]}]} 2023-06-23T18:49:55.190 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-23T18:49:55.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-23T18:49:55.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.310+0000 7f03a6d39640 1 Processor -- start 2023-06-23T18:49:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.310+0000 7f03a6d39640 1 -- start start 2023-06-23T18:49:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a6d39640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03a014b930 0x7f03a006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a6d39640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a00ba9d0 con 0x7f03a006c9b0 2023-06-23T18:49:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a6d39640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a0071080 con 0x7f03a00bd1e0 2023-06-23T18:49:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a6d39640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a00bc300 con 0x7f03a014b930 2023-06-23T18:49:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f03a006c9b0 0x7f03a0070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39542/0 (socket says 172.21.15.38:39542) 2023-06-23T18:49:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 -- 172.21.15.38:0/1200901719 learned_addr learned my addr 172.21.15.38:0/1200901719 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a4ad5640 1 --2- 172.21.15.38:0/1200901719 >> v2:172.21.15.81:3300/0 conn(0x7f03a014b930 0x7f03a006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941695842 0 0) 0x7f03a00ba9d0 con 0x7f03a006c9b0 2023-06-23T18:49:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c003530 con 0x7f03a006c9b0 2023-06-23T18:49:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123173909 0 0) 0x7f038c003530 con 0x7f03a006c9b0 2023-06-23T18:49:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 >> v2:172.21.15.81:3300/0 conn(0x7f03a014b930 msgr2=0x7f03a006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 --2- 172.21.15.38:0/1200901719 >> v2:172.21.15.81:3300/0 conn(0x7f03a014b930 0x7f03a006c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 >> v1:172.21.15.81:6789/0 conn(0x7f03a00bd1e0 legacy=0x7f03a0070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0150160 con 0x7f03a006c9b0 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f0398001a00 con 0x7f03a006c9b0 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 >> v1:172.21.15.38:6789/0 conn(0x7f03a006c9b0 legacy=0x7f03a0070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038c003980 0x7f038c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038c0047d0 0x7f038c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f038c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00bc300 con 0x7f038c005180 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c00c000 con 0x7f038c003980 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c00c1c0 con 0x7f038c0047d0 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f038c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a4ad5640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038c003980 0x7f038c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f039ffff640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038c0047d0 0x7f038c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 -- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038c0047d0 msgr2=0x7f038c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038c0047d0 0x7f038c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 -- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038c003980 msgr2=0x7f038c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038c003980 0x7f038c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.314+0000 7f03a52d6640 1 -- 172.21.15.38:0/1200901719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c003530 con 0x7f038c005180 2023-06-23T18:49:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a52d6640 1 -- 172.21.15.38:0/1200901719 reap_dead start 2023-06-23T18:49:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a52d6640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f038c00b990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f039800a830 tx=0x7f039801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6832230a466df203 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980072d0 con 0x7f038c005180 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03980a8070 con 0x7f038c005180 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039f7fe640 1 -- 172.21.15.38:0/1200901719 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980076b0 con 0x7f038c005180 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 msgr2=0x7f038c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f038c00b990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f039800a830 tx=0x7f039801d340 comp rx=0 tx=0).stop 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- 172.21.15.38:0/1200901719 shutdown_connections 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 --2- 172.21.15.38:0/1200901719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f038c00b990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- 172.21.15.38:0/1200901719 >> 172.21.15.38:0/1200901719 conn(0x7f03a00c0c90 msgr2=0x7f03a00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- 172.21.15.38:0/1200901719 shutdown_connections 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- 172.21.15.38:0/1200901719 wait complete. 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 Processor -- start 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- start start 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a00992e0 0x7f03a0147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03a00b7d80 0x7f03a0147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00a5570 con 0x7f038c005180 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00be5f0 con 0x7f03a00992e0 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a6d39640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0148010 con 0x7f03a00b7d80 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50780/0 (socket says 172.21.15.38:50780) 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 -- 172.21.15.38:0/3717486926 learned_addr learned my addr 172.21.15.38:0/3717486926 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039ffff640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a00992e0 0x7f03a0147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a52d6640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03a00b7d80 0x7f03a0147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 -- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03a00b7d80 msgr2=0x7f03a0147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03a00b7d80 0x7f03a0147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 -- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a00992e0 msgr2=0x7f03a0147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a00992e0 0x7f03a0147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 -- 172.21.15.38:0/3717486926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00a48b0 con 0x7f038c005180 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f03a4ad5640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0388011960 tx=0x7f0388011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800faf0 con 0x7f038c005180 2023-06-23T18:49:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.318+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800fc50 con 0x7f038c005180 2023-06-23T18:49:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00a45b0 con 0x7f038c005180 2023-06-23T18:49:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388014440 con 0x7f038c005180 2023-06-23T18:49:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a0098ae0 con 0x7f038c005180 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a004d790 con 0x7f038c005180 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03880145a0 con 0x7f038c005180 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039d7fa640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 0x7f0380068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0388084890 con 0x7f038c005180 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039ffff640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 0x7f0380068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.322+0000 7f039ffff640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 0x7f0380068760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03a0148ce0 tx=0x7f0390009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.326+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0388051a20 con 0x7f038c005180 2023-06-23T18:49:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.482+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03a0066f10 con 0x7f038c005180 2023-06-23T18:49:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.486+0000 7f039d7fa640 1 -- 172.21.15.38:0/3717486926 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f0388055040 con 0x7f038c005180 2023-06-23T18:49:55.491 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:55.492 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 msgr2=0x7f0380068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 0x7f0380068760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03a0148ce0 tx=0x7f0390009040 comp rx=0 tx=0).stop 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 msgr2=0x7f03a00be0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0388011960 tx=0x7f0388011e20 comp rx=0 tx=0).stop 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 shutdown_connections 2023-06-23T18:49:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f03800662b0 0x7f0380068760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03a00b7d80 0x7f03a0147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a00992e0 0x7f03a0147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 --2- 172.21.15.38:0/3717486926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f038c005180 0x7f03a00be0b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 >> 172.21.15.38:0/3717486926 conn(0x7f03a00c0c90 msgr2=0x7f03a00baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 shutdown_connections 2023-06-23T18:49:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.490+0000 7f03a6d39640 1 -- 172.21.15.38:0/3717486926 wait complete. 2023-06-23T18:49:55.512 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-23T18:49:55.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.630+0000 7f35f0a7d640 1 Processor -- start 2023-06-23T18:49:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.630+0000 7f35f0a7d640 1 -- start start 2023-06-23T18:49:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35f0a7d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35ec0bd1e0 0x7f35ec14c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35f0a7d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a630 0x7f35ec14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35f0a7d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0ba9d0 con 0x7f35ec14b930 2023-06-23T18:49:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35f0a7d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0bc300 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35f0a7d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0a5570 con 0x7f35ec06a630 2023-06-23T18:49:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e9d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35ec0bd1e0 0x7f35ec14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35ea59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f35ec14b930 0x7f35ec06c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39552/0 (socket says 172.21.15.38:39552) 2023-06-23T18:49:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35ea59c640 1 -- 172.21.15.38:0/4035136355 learned_addr learned my addr 172.21.15.38:0/4035136355 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e9d9b640 1 -- 172.21.15.38:0/4035136355 >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a630 msgr2=0x7f35ec14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e9d9b640 1 --2- 172.21.15.38:0/4035136355 >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a630 0x7f35ec14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e9d9b640 1 -- 172.21.15.38:0/4035136355 >> v1:172.21.15.38:6789/0 conn(0x7f35ec14b930 legacy=0x7f35ec06c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e959a640 1 -- 172.21.15.38:0/4035136355 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113613405 0 0) 0x7f35ec0ba9d0 con 0x7f35ec14b930 2023-06-23T18:49:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.634+0000 7f35e9d9b640 1 -- 172.21.15.38:0/4035136355 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec150160 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35e9d9b640 1 --2- 172.21.15.38:0/4035136355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec14c390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0b5060 tx=0x7f35e001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af371bdb593220de server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35e959a640 1 -- 172.21.15.38:0/4035136355 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00ab600 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35e959a640 1 -- 172.21.15.38:0/4035136355 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00a7050 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35e959a640 1 -- 172.21.15.38:0/4035136355 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00ab980 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- 172.21.15.38:0/4035136355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec0bd1e0 msgr2=0x7f35ec14c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/4035136355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec14c390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0b5060 tx=0x7f35e001c460 comp rx=0 tx=0).stop 2023-06-23T18:49:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- 172.21.15.38:0/4035136355 shutdown_connections 2023-06-23T18:49:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/4035136355 >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a630 0x7f35ec14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/4035136355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec14c390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- 172.21.15.38:0/4035136355 >> 172.21.15.38:0/4035136355 conn(0x7f35ec0c0c90 msgr2=0x7f35ec0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:55.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- 172.21.15.38:0/4035136355 shutdown_connections 2023-06-23T18:49:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- 172.21.15.38:0/4035136355 wait complete. 2023-06-23T18:49:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 Processor -- start 2023-06-23T18:49:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- start start 2023-06-23T18:49:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 0x7f35ec0bb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec14f950 con 0x7f35ec14b930 2023-06-23T18:49:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec06f6f0 con 0x7f35ec0bd1e0 2023-06-23T18:49:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35f0a7d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec1452d0 con 0x7f35ec06a630 2023-06-23T18:49:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50796/0 (socket says 172.21.15.38:50796) 2023-06-23T18:49:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 -- 172.21.15.38:0/711739910 learned_addr learned my addr 172.21.15.38:0/711739910 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ea59c640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 0x7f35ec0bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35e9d9b640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 -- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 msgr2=0x7f35ec0bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 0x7f35ec0bb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 -- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0bd1e0 msgr2=0x7f35ec144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ead9d640 1 -- 172.21.15.38:0/711739910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009420 con 0x7f35ec14b930 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.638+0000 7f35ea59c640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 0x7f35ec0bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35ead9d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35e400b970 tx=0x7f35e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400cb40 con 0x7f35ec14b930 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400ccc0 con 0x7f35ec14b930 2023-06-23T18:49:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec06cd00 con 0x7f35ec14b930 2023-06-23T18:49:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4014680 con 0x7f35ec14b930 2023-06-23T18:49:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec06f380 con 0x7f35ec14b930 2023-06-23T18:49:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec04d790 con 0x7f35ec14b930 2023-06-23T18:49:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35e401d3b0 con 0x7f35ec14b930 2023-06-23T18:49:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 0x7f35cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35e4084320 con 0x7f35ec14b930 2023-06-23T18:49:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35ea59c640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 0x7f35cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:55.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.642+0000 7f35ea59c640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 0x7f35cc068760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f70 tx=0x7f35dc007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:55.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.646+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35e4051590 con 0x7f35ec14b930 2023-06-23T18:49:55.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.794+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35ec066f10 con 0x7f35ec14b930 2023-06-23T18:49:55.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35daffd640 1 -- 172.21.15.38:0/711739910 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f35e4054bb0 con 0x7f35ec14b930 2023-06-23T18:49:55.802 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:55.802 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:55.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 msgr2=0x7f35cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 0x7f35cc068760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f70 tx=0x7f35dc007c40 comp rx=0 tx=0).stop 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 msgr2=0x7f35ec144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35e400b970 tx=0x7f35e400be30 comp rx=0 tx=0).stop 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 shutdown_connections 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f35cc0662b0 0x7f35cc068760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35ec14b930 0x7f35ec144a80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0bd1e0 0x7f35ec144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 --2- 172.21.15.38:0/711739910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35ec06a630 0x7f35ec0bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:55.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 >> 172.21.15.38:0/711739910 conn(0x7f35ec0c0c90 msgr2=0x7f35ec06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:55.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 shutdown_connections 2023-06-23T18:49:55.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.798+0000 7f35f0a7d640 1 -- 172.21.15.38:0/711739910 wait complete. 2023-06-23T18:49:55.819 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-23T18:49:55.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-23T18:49:55.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-23T18:49:55.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-23T18:49:55.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-23T18:49:55.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-23T18:49:55.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-23T18:49:55.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-23T18:49:55.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 Processor -- start 2023-06-23T18:49:55.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 -- start start 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4524070ef0 0x7f45241519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f452406e1a0 0x7f452414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45240bbbd0 con 0x7f45240696d0 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240bc180 con 0x7f4524070ef0 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f452b733640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4524070aa0 con 0x7f452406e1a0 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4524070ef0 0x7f45241519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4524070ef0 0x7f45241519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50810/0 (socket says 172.21.15.38:50810) 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 -- 172.21.15.38:0/2585550668 learned_addr learned my addr 172.21.15.38:0/2585550668 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4529cd0640 1 --2- 172.21.15.38:0/2585550668 >> v2:172.21.15.81:3300/0 conn(0x7f452406e1a0 0x7f452414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 -- 172.21.15.38:0/2585550668 >> v2:172.21.15.81:3300/0 conn(0x7f452406e1a0 msgr2=0x7f452414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 --2- 172.21.15.38:0/2585550668 >> v2:172.21.15.81:3300/0 conn(0x7f452406e1a0 0x7f452414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 -- 172.21.15.38:0/2585550668 >> v1:172.21.15.38:6789/0 conn(0x7f45240696d0 legacy=0x7f45241512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f451bfff640 1 -- 172.21.15.38:0/2585550668 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000877482 0 0) 0x7f45240bbbd0 con 0x7f45240696d0 2023-06-23T18:49:56.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.994+0000 7f4528cce640 1 -- 172.21.15.38:0/2585550668 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452406a580 con 0x7f4524070ef0 2023-06-23T18:49:56.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 Processor -- start 2023-06-23T18:49:56.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 -- start start 2023-06-23T18:49:56.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4528cce640 1 --2- 172.21.15.38:0/2585550668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4524070ef0 0x7f45241519c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45241523d0 tx=0x7f452001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaee69a3692225f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f451bfff640 1 -- 172.21.15.38:0/2585550668 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45200ab600 con 0x7f4524070ef0 2023-06-23T18:49:56.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f451bfff640 1 -- 172.21.15.38:0/2585550668 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45200ab760 con 0x7f4524070ef0 2023-06-23T18:49:56.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f451bfff640 1 -- 172.21.15.38:0/2585550668 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45200abaf0 con 0x7f4524070ef0 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 0x7f18e01512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 0x7f18e01517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 0x7f18e0151d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00bc180 con 0x7f18e0070ef0 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0070aa0 con 0x7f18e006e1a0 2023-06-23T18:49:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e7b81640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00bbbd0 con 0x7f18e00696d0 2023-06-23T18:49:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 -- 172.21.15.38:0/2585550668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4524070ef0 msgr2=0x7f45241519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 --2- 172.21.15.38:0/2585550668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4524070ef0 0x7f45241519c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45241523d0 tx=0x7f452001c400 comp rx=0 tx=0).stop 2023-06-23T18:49:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 -- 172.21.15.38:0/2585550668 shutdown_connections 2023-06-23T18:49:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 --2- 172.21.15.38:0/2585550668 >> v2:172.21.15.81:3300/0 conn(0x7f452406e1a0 0x7f452414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 --2- 172.21.15.38:0/2585550668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4524070ef0 0x7f45241519c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 -- 172.21.15.38:0/2585550668 >> 172.21.15.38:0/2585550668 conn(0x7f45240bc670 msgr2=0x7f45240bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 -- 172.21.15.38:0/2585550668 shutdown_connections 2023-06-23T18:49:56.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 Processor -- start 2023-06-23T18:49:56.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e611e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 0x7f18e0151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 0x7f18e01512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e611e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 0x7f18e0151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34082/0 (socket says 172.21.15.38:34082) 2023-06-23T18:49:56.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e611e640 1 -- 172.21.15.38:0/3748482954 learned_addr learned my addr 172.21.15.38:0/3748482954 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e511c640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 0x7f18e01517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f7266b92640 1 Processor -- start 2023-06-23T18:49:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f0ae359e640 1 Processor -- start 2023-06-23T18:49:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 -- start start 2023-06-23T18:49:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f6cd14f3640 1 Processor -- start 2023-06-23T18:49:56.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f6cd14f3640 1 -- start start 2023-06-23T18:49:56.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f7266b92640 1 -- start start 2023-06-23T18:49:56.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 -- 172.21.15.38:0/3748482954 >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 msgr2=0x7f18e0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 0x7f18e0151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 -- 172.21.15.38:0/3748482954 >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 msgr2=0x7f18e01517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 0x7f18e01517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e591d640 1 -- 172.21.15.38:0/3748482954 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e006a580 con 0x7f18e00696d0 2023-06-23T18:49:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f18e511c640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 0x7f18e01517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f452b733640 1 -- 172.21.15.38:0/2585550668 wait complete. 2023-06-23T18:49:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f0ae359e640 1 -- start start 2023-06-23T18:49:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 0x7f4c50042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c5002cb60 0x7f4c50006410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c50045460 con 0x7f4c50043310 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c50046cb0 con 0x7f4c5002cb60 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:55.998+0000 7f4c5eb3d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500267e0 con 0x7f4c50041750 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f7266b92640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f725802c460 0x7f7258045030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f7266b92640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7258043f20 0x7f7258044340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f7266b92640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7258045d30 con 0x7f7258046280 2023-06-23T18:49:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f7266b92640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580263f0 con 0x7f725802c460 2023-06-23T18:49:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f7266b92640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7258042b40 con 0x7f7258043f20 2023-06-23T18:49:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae359e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0adc03e880 0x7f0adc0da1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae359e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 0x7f0adc0457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae359e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc030f80 con 0x7f0adc04a1f0 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae359e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc030900 con 0x7f0adc03e880 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae359e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc030b10 con 0x7f0adc04ab80 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5d33a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5d33a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50836/0 (socket says 172.21.15.38:50836) 2023-06-23T18:49:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5d33a640 1 -- 172.21.15.38:0/2838966662 learned_addr learned my addr 172.21.15.38:0/2838966662 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f725802c460 0x7f7258045030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f725802c460 0x7f7258045030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50852/0 (socket says 172.21.15.38:50852) 2023-06-23T18:49:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 -- 172.21.15.38:0/3441893172 learned_addr learned my addr 172.21.15.38:0/3441893172 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cd14f3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ccc071290 0x7f6ccc1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cd14f3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 0x7f6ccc06be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cd14f3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0ba040 con 0x7f6ccc14ba30 2023-06-23T18:49:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cd14f3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc06cad0 con 0x7f6ccc071290 2023-06-23T18:49:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cd14f3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0a5480 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 Processor -- start 2023-06-23T18:49:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cca7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ccc071290 0x7f6ccc1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 Processor -- start 2023-06-23T18:49:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0adc04a1f0 0x7f0adc02a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:54944/0 (socket says 172.21.15.38:54944) 2023-06-23T18:49:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae259c640 1 -- 172.21.15.38:0/796236822 learned_addr learned my addr 172.21.15.38:0/796236822 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2838966662 >> v2:172.21.15.81:3300/0 conn(0x7f4c5002cb60 0x7f4c50006410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae1d9b640 1 --2- 172.21.15.38:0/796236822 >> v2:172.21.15.81:3300/0 conn(0x7f0adc03e880 0x7f0adc0da1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5db3b640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 0x7f4c50042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccb7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 0x7f6ccc06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/796236822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 0x7f0adc0457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccaffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ccc14ba30 0x7f6ccc0b93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39586/0 (socket says 172.21.15.38:39586) 2023-06-23T18:49:56.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccaffd640 1 -- 172.21.15.38:0/3808367411 learned_addr learned my addr 172.21.15.38:0/3808367411 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:56.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726512f640 1 --2- 172.21.15.38:0/3441893172 >> v2:172.21.15.81:3300/0 conn(0x7f7258043f20 0x7f7258044340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 Processor -- start 2023-06-23T18:49:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 -- start start 2023-06-23T18:49:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 -- 172.21.15.38:0/3441893172 >> v2:172.21.15.81:3300/0 conn(0x7f7258043f20 msgr2=0x7f7258044340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 --2- 172.21.15.38:0/3441893172 >> v2:172.21.15.81:3300/0 conn(0x7f7258043f20 0x7f7258044340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 -- 172.21.15.38:0/3441893172 >> v1:172.21.15.38:6789/0 conn(0x7f7258046280 legacy=0x7f72580d4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f726492e640 1 -- 172.21.15.38:0/3441893172 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725802c830 con 0x7f725802c460 2023-06-23T18:49:56.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 -- start start 2023-06-23T18:49:56.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 -- start start 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 0x7f45241e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f452406e1a0 0x7f452413a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4524070ef0 0x7f4524146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452414f730 con 0x7f452406e1a0 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45241ea250 con 0x7f4524070ef0 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f452b733640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452413ad50 con 0x7f45240696d0 2023-06-23T18:49:56.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 0x7f45241e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 0x7f45241e9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49316/0 (socket says 172.21.15.38:49316) 2023-06-23T18:49:56.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 -- 172.21.15.38:0/502650432 learned_addr learned my addr 172.21.15.38:0/502650432 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4529cd0640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4524070ef0 0x7f4524146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f223802cb60 0x7f22380065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2238046cb0 con 0x7f2238043310 2023-06-23T18:49:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae2d9d640 1 -- 172.21.15.38:0/796236822 >> v2:172.21.15.81:3300/0 conn(0x7f0adc03e880 msgr2=0x7f0adc0da1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/796236822 >> v2:172.21.15.81:3300/0 conn(0x7f0adc03e880 0x7f0adc0da1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae2d9d640 1 -- 172.21.15.38:0/796236822 >> v1:172.21.15.81:6789/0 conn(0x7f0adc04a1f0 legacy=0x7f0adc02a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f0ae2d9d640 1 -- 172.21.15.38:0/796236822 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc041f00 con 0x7f0adc04ab80 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cc9ffb640 1 -- 172.21.15.38:0/3808367411 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434793620 0 0) 0x7f6ccc0ba040 con 0x7f6ccc14ba30 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6cc9ffb640 1 -- 172.21.15.38:0/3808367411 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb4003530 con 0x7f6ccc14ba30 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/3808367411 >> v2:172.21.15.38:3300/0 conn(0x7f6ccc071290 msgr2=0x7f6ccc1518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccb7fe640 1 --2- 172.21.15.38:0/3808367411 >> v2:172.21.15.38:3300/0 conn(0x7f6ccc071290 0x7f6ccc1518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/3808367411 >> v1:172.21.15.38:6789/0 conn(0x7f6ccc14ba30 legacy=0x7f6ccc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/3808367411 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0ba3c0 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 msgr2=0x7f4c50042dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 0x7ff75c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75c089910 con 0x7ff75c070ef0 2023-06-23T18:49:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75c0b4ce0 con 0x7ff75c15e140 2023-06-23T18:49:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762a62640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15baf0 con 0x7ff75c15eda0 2023-06-23T18:49:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2238045460 con 0x7f223802cb60 2023-06-23T18:49:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223ffff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380267e0 con 0x7f2238041750 2023-06-23T18:49:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 0x7f4c50042dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2838966662 >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 msgr2=0x7f4c50005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2838966662 >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff761a60640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff761a60640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50880/0 (socket says 172.21.15.38:50880) 2023-06-23T18:49:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff761a60640 1 -- 172.21.15.38:0/3226060089 learned_addr learned my addr 172.21.15.38:0/3226060089 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49338/0 (socket says 172.21.15.38:49338) 2023-06-23T18:49:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 -- 172.21.15.38:0/3777096334 learned_addr learned my addr 172.21.15.38:0/3777096334 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4528cce640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f452406e1a0 0x7f452413a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 -- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4524070ef0 msgr2=0x7f4524146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4524070ef0 0x7f4524146750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 -- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f452406e1a0 msgr2=0x7f452413a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f452406e1a0 0x7f452413a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45200094d0 con 0x7f45240696d0 2023-06-23T18:49:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2838966662 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5003a7c0 con 0x7f4c5002cb60 2023-06-23T18:49:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5d33a640 1 --2- 172.21.15.38:0/2838966662 >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4528cce640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f452406e1a0 0x7f452413a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:56.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7ff762261640 1 --2- 172.21.15.38:0/3226060089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 0x7ff75c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4c5db3b640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 0x7f4c50042dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223f7fe640 1 --2- 172.21.15.38:0/3777096334 >> v2:172.21.15.38:3300/0 conn(0x7f223802cb60 0x7f22380065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f4529cd0640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4524070ef0 0x7f4524146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f45294cf640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 0x7f45241e9d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c7d0 tx=0x7f451c00cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c003db0 con 0x7f45240696d0 2023-06-23T18:49:56.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c00ce20 con 0x7f45240696d0 2023-06-23T18:49:56.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 -- 172.21.15.38:0/3777096334 >> v2:172.21.15.38:3300/0 conn(0x7f223802cb60 msgr2=0x7f22380065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 --2- 172.21.15.38:0/3777096334 >> v2:172.21.15.38:3300/0 conn(0x7f223802cb60 0x7f22380065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 -- 172.21.15.38:0/3777096334 >> v1:172.21.15.38:6789/0 conn(0x7f2238043310 legacy=0x7f2238005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.002+0000 7f223effd640 1 -- 172.21.15.38:0/3777096334 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223803a7c0 con 0x7f2238041750 2023-06-23T18:49:56.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff760a5e640 1 -- 172.21.15.38:0/3226060089 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859819890 0 0) 0x7ff75c089910 con 0x7ff75c070ef0 2023-06-23T18:49:56.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f726492e640 1 --2- 172.21.15.38:0/3441893172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f725802c460 0x7f7258045030 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7260068c60 tx=0x7f7260097c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16cf63f6b852493 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff760a5e640 1 -- 172.21.15.38:0/3226060089 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff748003530 con 0x7ff75c070ef0 2023-06-23T18:49:56.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f725f7fe640 1 -- 172.21.15.38:0/3441893172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260120a70 con 0x7f725802c460 2023-06-23T18:49:56.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e591d640 1 --2- 172.21.15.38:0/3748482954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 0x7f18e01512b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18e01523d0 tx=0x7f18dc01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c32716c76a7a09 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f725f7fe640 1 -- 172.21.15.38:0/3441893172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260124070 con 0x7f725802c460 2023-06-23T18:49:56.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f725f7fe640 1 -- 172.21.15.38:0/3441893172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260120e30 con 0x7f725802c460 2023-06-23T18:49:56.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/796236822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 0x7f0adc0457c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097c0 tx=0x7f0ad401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c722b479526572ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6ccb7fe640 1 --2- 172.21.15.38:0/3808367411 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 0x7f6ccc06be70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b685e3b9465b82d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e491b640 1 -- 172.21.15.38:0/3748482954 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0ab600 con 0x7f18e00696d0 2023-06-23T18:49:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae159a640 1 -- 172.21.15.38:0/796236822 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40ab600 con 0x7f0adc04ab80 2023-06-23T18:49:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cc9ffb640 1 -- 172.21.15.38:0/3808367411 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40a59a0 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452414ae70 con 0x7f45240696d0 2023-06-23T18:49:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452414caf0 con 0x7f45240696d0 2023-06-23T18:49:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c005270 con 0x7f45240696d0 2023-06-23T18:49:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae159a640 1 -- 172.21.15.38:0/796236822 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40a7050 con 0x7f0adc04ab80 2023-06-23T18:49:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae159a640 1 -- 172.21.15.38:0/796236822 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40ab980 con 0x7f0adc04ab80 2023-06-23T18:49:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff762261640 1 -- 172.21.15.38:0/3226060089 >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 msgr2=0x7ff75c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff762261640 1 --2- 172.21.15.38:0/3226060089 >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff762261640 1 -- 172.21.15.38:0/3226060089 >> v1:172.21.15.81:6789/0 conn(0x7ff75c070ef0 legacy=0x7ff75c06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff762261640 1 -- 172.21.15.38:0/3226060089 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0893e0 con 0x7ff75c15eda0 2023-06-23T18:49:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e491b640 1 -- 172.21.15.38:0/3748482954 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0a7050 con 0x7f18e00696d0 2023-06-23T18:49:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 -- 172.21.15.38:0/3748482954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 msgr2=0x7f18e01512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- 172.21.15.38:0/3441893172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f725802c460 msgr2=0x7f7258045030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 --2- 172.21.15.38:0/3441893172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f725802c460 0x7f7258045030 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7260068c60 tx=0x7f7260097c70 comp rx=0 tx=0).stop 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- 172.21.15.38:0/3441893172 shutdown_connections 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 --2- 172.21.15.38:0/3441893172 >> v2:172.21.15.81:3300/0 conn(0x7f7258043f20 0x7f7258044340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 --2- 172.21.15.38:0/3441893172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f725802c460 0x7f7258045030 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- 172.21.15.38:0/3441893172 >> 172.21.15.38:0/3441893172 conn(0x7f72580479e0 msgr2=0x7f7258043810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- 172.21.15.38:0/3441893172 shutdown_connections 2023-06-23T18:49:56.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7ff761a60640 1 --2- 172.21.15.38:0/3226060089 >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f452414e700 con 0x7f45240696d0 2023-06-23T18:49:56.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 -- 172.21.15.38:0/796236822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 msgr2=0x7f0adc0457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 --2- 172.21.15.38:0/796236822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 0x7f0adc0457c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097c0 tx=0x7f0ad401c370 comp rx=0 tx=0).stop 2023-06-23T18:49:56.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e491b640 1 -- 172.21.15.38:0/3748482954 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0ab600 con 0x7f18e00696d0 2023-06-23T18:49:56.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223effd640 1 --2- 172.21.15.38:0/3777096334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2230009870 tx=0x7f223001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a4dd50deec3a85 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 --2- 172.21.15.38:0/3748482954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 0x7f18e01512b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18e01523d0 tx=0x7f18dc01c340 comp rx=0 tx=0).stop 2023-06-23T18:49:56.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- 172.21.15.38:0/3441893172 wait complete. 2023-06-23T18:49:56.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 -- 172.21.15.38:0/796236822 shutdown_connections 2023-06-23T18:49:56.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 --2- 172.21.15.38:0/796236822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04ab80 0x7f0adc0457c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 --2- 172.21.15.38:0/796236822 >> v2:172.21.15.81:3300/0 conn(0x7f0adc03e880 0x7f0adc0da1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 -- 172.21.15.38:0/796236822 >> 172.21.15.38:0/796236822 conn(0x7f0adc04b170 msgr2=0x7f0adc04b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cc9ffb640 1 -- 172.21.15.38:0/3808367411 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40a5b00 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cc9ffb640 1 -- 172.21.15.38:0/3808367411 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40a5e70 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 -- 172.21.15.38:0/3808367411 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 msgr2=0x7f6ccc06be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/3808367411 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 0x7f6ccc06be70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc401c8c0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 -- 172.21.15.38:0/796236822 shutdown_connections 2023-06-23T18:49:56.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 -- 172.21.15.38:0/3808367411 shutdown_connections 2023-06-23T18:49:56.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/3808367411 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc0a4db0 0x7f6ccc06be70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/3808367411 >> v2:172.21.15.38:3300/0 conn(0x7f6ccc071290 0x7f6ccc1518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 -- 172.21.15.38:0/3808367411 >> 172.21.15.38:0/3808367411 conn(0x7f6ccc0c0050 msgr2=0x7f6ccc0c0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 -- 172.21.15.38:0/3748482954 shutdown_connections 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.81:3300/0 conn(0x7f18e006e1a0 0x7f18e0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 --2- 172.21.15.38:0/3748482954 >> v2:172.21.15.38:3300/0 conn(0x7f18e0070ef0 0x7f18e01517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 --2- 172.21.15.38:0/3748482954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e00696d0 0x7f18e01512b0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18e01523d0 tx=0x7f18dc01c340 comp rx=0 tx=0).stop 2023-06-23T18:49:56.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 -- 172.21.15.38:0/3748482954 >> 172.21.15.38:0/3748482954 conn(0x7f18e00bc670 msgr2=0x7f18e00bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223dffb640 1 -- 172.21.15.38:0/3777096334 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300ab610 con 0x7f2238041750 2023-06-23T18:49:56.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 -- 172.21.15.38:0/3808367411 shutdown_connections 2023-06-23T18:49:56.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f6cd14f3640 1 -- 172.21.15.38:0/3808367411 wait complete. 2023-06-23T18:49:56.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c50006410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c5804da60 tx=0x7f4c580954d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15247370439c475c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223dffb640 1 -- 172.21.15.38:0/3777096334 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22300ab770 con 0x7f2238041750 2023-06-23T18:49:56.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223dffb640 1 -- 172.21.15.38:0/3777096334 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300abb00 con 0x7f2238041750 2023-06-23T18:49:56.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 -- 172.21.15.38:0/3748482954 shutdown_connections 2023-06-23T18:49:56.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 Processor -- start 2023-06-23T18:49:56.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4c5cb39640 1 -- 172.21.15.38:0/2838966662 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58124600 con 0x7f4c5002cb60 2023-06-23T18:49:56.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f4c5cb39640 1 -- 172.21.15.38:0/2838966662 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c58120050 con 0x7f4c5002cb60 2023-06-23T18:49:56.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223ffff640 1 -- 172.21.15.38:0/3777096334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 msgr2=0x7f2238042dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f223ffff640 1 --2- 172.21.15.38:0/3777096334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2230009870 tx=0x7f223001c410 comp rx=0 tx=0).stop 2023-06-23T18:49:56.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f18e7b81640 1 -- 172.21.15.38:0/3748482954 wait complete. 2023-06-23T18:49:56.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 Processor -- start 2023-06-23T18:49:56.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f0ae359e640 1 -- 172.21.15.38:0/796236822 wait complete. 2023-06-23T18:49:56.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.006+0000 7f7266b92640 1 -- start start 2023-06-23T18:49:56.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725802c460 0x7f725803f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 Processor -- start 2023-06-23T18:49:56.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 0x7f7258039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7258046280 0x7f7258039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580cd5c0 con 0x7f7258046280 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580ccf70 con 0x7f725802c460 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f7266b92640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580cd250 con 0x7f7258043f20 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- 172.21.15.38:0/3777096334 shutdown_connections 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 --2- 172.21.15.38:0/3777096334 >> v2:172.21.15.38:3300/0 conn(0x7f223802cb60 0x7f22380065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 --2- 172.21.15.38:0/3777096334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2238041750 0x7f2238042dd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- 172.21.15.38:0/3777096334 >> 172.21.15.38:0/3777096334 conn(0x7f2238043920 msgr2=0x7f2238043cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 0x7f7258039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 Processor -- start 2023-06-23T18:49:56.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 0x7f7258039810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49350/0 (socket says 172.21.15.38:49350) 2023-06-23T18:49:56.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 -- 172.21.15.38:0/1457570756 learned_addr learned my addr 172.21.15.38:0/1457570756 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- 172.21.15.38:0/3777096334 shutdown_connections 2023-06-23T18:49:56.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- 172.21.15.38:0/3777096334 wait complete. 2023-06-23T18:49:56.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5cb39640 1 -- 172.21.15.38:0/2838966662 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58124a20 con 0x7f4c5002cb60 2023-06-23T18:49:56.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 msgr2=0x7f4c50006410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c50006410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c5804da60 tx=0x7f4c580954d0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f726512f640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7258046280 0x7f7258039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f726492e640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725802c460 0x7f725803f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- start start 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc071290 0x7f6ccc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ccc0a4db0 0x7f6ccc0bde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 0x7f6ccc0be390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b70c0 con 0x7f6ccc14ba30 2023-06-23T18:49:56.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1374e0 con 0x7f6ccc0a4db0 2023-06-23T18:49:56.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc06f680 con 0x7f6ccc071290 2023-06-23T18:49:56.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 -- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725802c460 msgr2=0x7f725803f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725802c460 0x7f725803f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 -- 172.21.15.38:0/1457570756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7258046280 msgr2=0x7f7258039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7258046280 0x7f7258039d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2838966662 shutdown_connections 2023-06-23T18:49:56.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c50006410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 --2- 172.21.15.38:0/2838966662 >> v2:172.21.15.38:3300/0 conn(0x7f4c50043310 0x7f4c50005ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 --2- 172.21.15.38:0/2838966662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50041750 0x7f4c50042dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726004dd00 con 0x7f7258043f20 2023-06-23T18:49:56.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2838966662 >> 172.21.15.38:0/2838966662 conn(0x7f4c50043920 msgr2=0x7f4c50043cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f451c0053d0 con 0x7f45240696d0 2023-06-23T18:49:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 0x7f6ccc0be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 0x7f6ccc0be390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50920/0 (socket says 172.21.15.38:50920) 2023-06-23T18:49:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/1151125062 learned_addr learned my addr 172.21.15.38:0/1151125062 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cca7fc640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ccc0a4db0 0x7f6ccc0bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccaffd640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc071290 0x7f6ccc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 -- start start 2023-06-23T18:49:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc03e880 0x7f0adc03d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04a1f0 0x7f0adc028f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc04ab80 0x7f0adc0294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc03e340 con 0x7f0adc03e880 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc041810 con 0x7f0adc04ab80 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae359e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0d4430 con 0x7f0adc04a1f0 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae1d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04a1f0 0x7f0adc028f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae1d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04a1f0 0x7f0adc028f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49380/0 (socket says 172.21.15.38:49380) 2023-06-23T18:49:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae1d9b640 1 -- 172.21.15.38:0/966406064 learned_addr learned my addr 172.21.15.38:0/966406064 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2838966662 shutdown_connections 2023-06-23T18:49:56.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725ffff640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 0x7f7258039810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f725400b3e0 tx=0x7f725400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2838966662 wait complete. 2023-06-23T18:49:56.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc071290 msgr2=0x7f6ccc150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6ccc071290 0x7f6ccc150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ccc0a4db0 msgr2=0x7f6ccc0bde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4508066350 0x7f4508068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ccc0a4db0 0x7f6ccc0bde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009a70 con 0x7f6ccc14ba30 2023-06-23T18:49:56.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 -- start start 2023-06-23T18:49:56.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e006e1a0 0x7f18e00b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 0x7f18e014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e0150400 0x7f18e01e2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc04ab80 0x7f0adc0294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f451c0842a0 con 0x7f45240696d0 2023-06-23T18:49:56.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6ccb7fe640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 0x7f6ccc0be390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40b0040 tx=0x7f6cc4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 Processor -- start 2023-06-23T18:49:56.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4528cce640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4508066350 0x7f4508068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc03e880 0x7f0adc03d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e611e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e0150400 0x7f18e01e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e611e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e0150400 0x7f18e01e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34154/0 (socket says 172.21.15.38:34154) 2023-06-23T18:49:56.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 0x7f18e014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 0x7f18e014fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49390/0 (socket says 172.21.15.38:49390) 2023-06-23T18:49:56.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e591d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e006e1a0 0x7f18e00b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e591d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e006e1a0 0x7f18e00b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50952/0 (socket says 172.21.15.38:50952) 2023-06-23T18:49:56.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f450806feb0 0x7f45080722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45080729b0 con 0x7f450806feb0 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f451c084650 con 0x7f45240696d0 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4529cd0640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f450806feb0 0x7f45080722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 -- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04a1f0 msgr2=0x7f0adc028f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0adc04a1f0 0x7f0adc028f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 -- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc04ab80 msgr2=0x7f0adc0294d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc04ab80 0x7f0adc0294d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009420 con 0x7f0adc03e880 2023-06-23T18:49:56.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4004240 con 0x7f6ccc14ba30 2023-06-23T18:49:56.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40043a0 con 0x7f6ccc14ba30 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4004730 con 0x7f6ccc14ba30 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc06f210 con 0x7f6ccc14ba30 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc137240 con 0x7f6ccc14ba30 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e611e640 1 -- 172.21.15.38:0/4054666827 learned_addr learned my addr 172.21.15.38:0/4054666827 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b9820 con 0x7f18e006e1a0 2023-06-23T18:49:56.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b86c0 con 0x7f18e0150400 2023-06-23T18:49:56.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0151920 con 0x7f18e0070ef0 2023-06-23T18:49:56.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- start start 2023-06-23T18:49:56.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f0ae259c640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc03e880 0x7f0adc03d8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c460 tx=0x7f0ad800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f223802cb60 0x7f22380dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2238041750 0x7f2238171630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238043310 0x7f2238171b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22381755d0 con 0x7f2238041750 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380db450 con 0x7f2238043310 2023-06-23T18:49:56.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f223ffff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380dd610 con 0x7f223802cb60 2023-06-23T18:49:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 -- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e0150400 msgr2=0x7f18e01e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e0150400 0x7f18e01e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 -- 172.21.15.38:0/4054666827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e006e1a0 msgr2=0x7f18e00b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e006e1a0 0x7f18e00b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f18e511c640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0011cc0 con 0x7f18e0070ef0 2023-06-23T18:49:56.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4c5eb3d640 1 Processor -- start 2023-06-23T18:49:56.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f4528cce640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4508066350 0x7f4508068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45200af000 tx=0x7f4520008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4529cd0640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f450806feb0 0x7f45080722e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f223802cb60 0x7f22380dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8005cf0 con 0x7f0adc03e880 2023-06-23T18:49:56.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18e511c640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 0x7f18e014fec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18d0016fa0 tx=0x7f18d0014550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f223802cb60 0x7f22380dd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49392/0 (socket says 172.21.15.38:49392) 2023-06-23T18:49:56.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223effd640 1 -- 172.21.15.38:0/2414870239 learned_addr learned my addr 172.21.15.38:0/2414870239 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 -- start start 2023-06-23T18:49:56.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238043310 0x7f2238171b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.010+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011830 con 0x7f7258043f20 2023-06-23T18:49:56.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254011990 con 0x7f7258043f20 2023-06-23T18:49:56.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011d60 con 0x7f7258043f20 2023-06-23T18:49:56.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f7266b92640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7258040e50 con 0x7f7258043f20 2023-06-23T18:49:56.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f7266b92640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258041130 con 0x7f7258043f20 2023-06-23T18:49:56.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ccc04d790 con 0x7f6ccc14ba30 2023-06-23T18:49:56.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00112d0 con 0x7f18e0070ef0 2023-06-23T18:49:56.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0017040 con 0x7f18e0070ef0 2023-06-23T18:49:56.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011650 con 0x7f18e0070ef0 2023-06-23T18:49:56.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8005e50 con 0x7f0adc03e880 2023-06-23T18:49:56.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8007270 con 0x7f0adc03e880 2023-06-23T18:49:56.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 -- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f223802cb60 msgr2=0x7f22380dd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f223802cb60 0x7f22380dd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc042090 con 0x7f0adc03e880 2023-06-23T18:49:56.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 -- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2238041750 msgr2=0x7f2238171630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2238041750 0x7f2238171630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300094d0 con 0x7f2238043310 2023-06-23T18:49:56.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223f7fe640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238043310 0x7f2238171b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f223400e820 tx=0x7f223400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c5003a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0d1950 con 0x7f0adc03e880 2023-06-23T18:49:56.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== osd.0 v2:172.21.15.38:6818/575541123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f45080729b0 con 0x7f450806feb0 2023-06-23T18:49:56.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f7266b92640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7258026110 con 0x7f7258043f20 2023-06-23T18:49:56.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc009420 con 0x7f18e0070ef0 2023-06-23T18:49:56.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400c730 con 0x7f2238043310 2023-06-23T18:49:56.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400c890 con 0x7f2238043310 2023-06-23T18:49:56.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400cc20 con 0x7f2238043310 2023-06-23T18:49:56.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0adc046110 con 0x7f0adc03e880 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c50041750 0x7f4c500404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50043310 0x7f4c500dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5db3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c5003a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500e1430 con 0x7f4c50041750 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5db3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c5003a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34180/0 (socket says 172.21.15.38:34180) 2023-06-23T18:49:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5003bf70 con 0x7f4c5002cb60 2023-06-23T18:49:56.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5db3b640 1 -- 172.21.15.38:0/2832631236 learned_addr learned my addr 172.21.15.38:0/2832631236 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5003c250 con 0x7f4c50043310 2023-06-23T18:49:56.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50043310 0x7f4c500dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5d33a640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c50041750 0x7f4c500404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7ff762261640 1 --2- 172.21.15.38:0/3226060089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 0x7ff75c06c150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeff36612e9c1bbb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00bae30 con 0x7f18e0070ef0 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18e0151780 con 0x7f18e0070ef0 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 msgr2=0x7f4c5003a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c5003a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2832631236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c50041750 msgr2=0x7f4c500404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c50041750 0x7f4c500404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009420 con 0x7f4c50043310 2023-06-23T18:49:56.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5db3b640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c5002cb60 0x7f4c5003a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:56.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5d33a640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c50041750 0x7f4c500404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:56.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2238175af0 con 0x7f2238043310 2023-06-23T18:49:56.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2238175810 con 0x7f2238043310 2023-06-23T18:49:56.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2238044da0 con 0x7f2238043310 2023-06-23T18:49:56.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5e33c640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50043310 0x7f4c500dbb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c5804f130 tx=0x7f4c58093d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5812d440 con 0x7f4c50043310 2023-06-23T18:49:56.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5812d5a0 con 0x7f4c50043310 2023-06-23T18:49:56.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5812d910 con 0x7f4c50043310 2023-06-23T18:49:56.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c480094d0 con 0x7f4c50043310 2023-06-23T18:49:56.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c5eb3d640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c500e02f0 con 0x7f4c50043310 2023-06-23T18:49:56.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7ff760a5e640 1 -- 172.21.15.38:0/3226060089 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a5950 con 0x7ff75c15eda0 2023-06-23T18:49:56.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7ff760a5e640 1 -- 172.21.15.38:0/3226060089 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540a5ab0 con 0x7ff75c15eda0 2023-06-23T18:49:56.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7ff760a5e640 1 -- 172.21.15.38:0/3226060089 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a5e40 con 0x7ff75c15eda0 2023-06-23T18:49:56.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- 172.21.15.38:0/3226060089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 msgr2=0x7ff75c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 --2- 172.21.15.38:0/3226060089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 0x7ff75c06c150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c890 comp rx=0 tx=0).stop 2023-06-23T18:49:56.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f725401a400 con 0x7f7258043f20 2023-06-23T18:49:56.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7244066300 0x7f72440687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7254084540 con 0x7f7258043f20 2023-06-23T18:49:56.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c38000fd0 con 0x7f4c50043310 2023-06-23T18:49:56.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f724406ffd0 0x7f7244072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7244072ad0 con 0x7f724406ffd0 2023-06-23T18:49:56.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72540849e0 con 0x7f7258043f20 2023-06-23T18:49:56.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- 172.21.15.38:0/3226060089 shutdown_connections 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 --2- 172.21.15.38:0/3226060089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c15eda0 0x7ff75c06c150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 --2- 172.21.15.38:0/3226060089 >> v2:172.21.15.38:3300/0 conn(0x7ff75c15e140 0x7ff75c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- 172.21.15.38:0/3226060089 >> 172.21.15.38:0/3226060089 conn(0x7ff75c0bc690 msgr2=0x7ff75c0bca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- 172.21.15.38:0/3226060089 shutdown_connections 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- 172.21.15.38:0/3226060089 wait complete. 2023-06-23T18:49:56.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18d000f850 con 0x7f18e0070ef0 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f18c40662b0 0x7f18c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18d008d0e0 con 0x7f18e0070ef0 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f18c406ff00 0x7f18c4072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18e591d640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f18c40662b0 0x7f18c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18c4072a00 con 0x7f18c406ff00 2023-06-23T18:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18d008d530 con 0x7f18e0070ef0 2023-06-23T18:49:56.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c5812b070 con 0x7f4c50043310 2023-06-23T18:49:56.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18e611e640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f18c406ff00 0x7f18c4072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f223400cd80 con 0x7f2238043310 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f222c0662d0 0x7f222c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f22340842a0 con 0x7f2238043310 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f222c06ffa0 0x7f222c0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f222c072aa0 con 0x7f222c06ffa0 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2234084740 con 0x7f2238043310 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f223effd640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f222c0662d0 0x7f222c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f223e7fc640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f222c06ffa0 0x7f222c0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f726512f640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f724406ffd0 0x7f7244072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f726492e640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7244066300 0x7f72440687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18e591d640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f18c40662b0 0x7f18c4068760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0ad000 tx=0x7f18dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 Processor -- start 2023-06-23T18:49:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4c3c066280 0x7f4c3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f18e611e640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f18c406ff00 0x7f18c4072330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7ff762a62640 1 -- start start 2023-06-23T18:49:56.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c58196fe0 con 0x7f4c50043310 2023-06-23T18:49:56.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7f4c3c06fed0 0x7f4c3c072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c5db3b640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4c3c066280 0x7f4c3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c3c0729d0 con 0x7f4c3c06fed0 2023-06-23T18:49:56.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c58197390 con 0x7f4c50043310 2023-06-23T18:49:56.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6cc40ad440 con 0x7f6ccc14ba30 2023-06-23T18:49:56.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cb37fe640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6cb8066350 0x7f6cb8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6cc411f490 con 0x7f6ccc14ba30 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cb37fe640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f6cb806ffa0 0x7f6cb80723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.014+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cb8072aa0 con 0x7f6cb806ffa0 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f6cca7fc640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f6cb806ffa0 0x7f6cb80723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f6ccaffd640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6cb8066350 0x7f6cb8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f6cca7fc640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f6cb806ffa0 0x7f6cb80723d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.018+0000 7f6ccaffd640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6cb8066350 0x7f6cb8068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0011f0 tx=0x7f6cbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f223effd640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f222c0662d0 0x7f222c068780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f223001a040 tx=0x7f22300a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc4004890 con 0x7f6ccc14ba30 2023-06-23T18:49:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f4c5d33a640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7f4c3c06fed0 0x7f4c3c072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f726512f640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f724406ffd0 0x7f7244072400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f223e7fc640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f222c06ffa0 0x7f222c0723d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f726492e640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7244066300 0x7f72440687b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72580076d0 tx=0x7f7260122070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c070ef0 0x7ff75c153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff75c15e140 0x7ff75c083620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 0x7ff75c083b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c15d740 con 0x7ff75c15eda0 2023-06-23T18:49:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c1538b0 con 0x7ff75c15e140 2023-06-23T18:49:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c0840a0 con 0x7ff75c070ef0 2023-06-23T18:49:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== osd.3 v2:172.21.15.38:6816/1363740470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6cb8072aa0 con 0x7f6cb806ffa0 2023-06-23T18:49:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 0x7ff75c083b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 0x7ff75c083b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50968/0 (socket says 172.21.15.38:50968) 2023-06-23T18:49:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 -- 172.21.15.38:0/2986952324 learned_addr learned my addr 172.21.15.38:0/2986952324 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff76125f640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff75c15e140 0x7ff75c083620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff761a60640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c070ef0 0x7ff75c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== osd.1 v2:172.21.15.38:6800/978431787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f222c072aa0 con 0x7f222c06ffa0 2023-06-23T18:49:56.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 -- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c070ef0 msgr2=0x7ff75c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff75c070ef0 0x7ff75c153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 -- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff75c15e140 msgr2=0x7ff75c083620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff75c15e140 0x7ff75c083620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7580094d0 con 0x7ff75c15eda0 2023-06-23T18:49:56.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762261640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 0x7ff75c083b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b0040 tx=0x7ff754019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== osd.7 v2:172.21.15.81:6824/3767203985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7244072ad0 con 0x7f724406ffd0 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ad80073d0 con 0x7f0adc03e880 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0ac40662b0 0x7f0ac4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0ad8084010 con 0x7f0adc03e880 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f0ac406ff80 0x7f0ac40723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ac4072a80 con 0x7f0ac406ff80 2023-06-23T18:49:56.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ad80843c0 con 0x7f0adc03e880 2023-06-23T18:49:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540adca0 con 0x7ff75c15eda0 2023-06-23T18:49:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff754009a70 con 0x7ff75c15eda0 2023-06-23T18:49:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c1ff250 con 0x7ff75c15eda0 2023-06-23T18:49:56.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff75c0a5830 con 0x7ff75c15eda0 2023-06-23T18:49:56.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540ade00 con 0x7ff75c15eda0 2023-06-23T18:49:56.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f4c5d33a640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7f4c3c06fed0 0x7f4c3c072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.022+0000 7f4c5db3b640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4c3c066280 0x7f4c3c068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c540114b0 tx=0x7f4c54009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540b9690 con 0x7ff75c15eda0 2023-06-23T18:49:56.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7540b9870 con 0x7ff75c15eda0 2023-06-23T18:49:56.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff7400663d0 0x7ff740068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff75411fb70 con 0x7ff75c15eda0 2023-06-23T18:49:56.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7ff74006ff30 0x7ff740072360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff761a60640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff7400663d0 0x7ff740068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff740072a30 con 0x7ff74006ff30 2023-06-23T18:49:56.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff75411fe50 con 0x7ff75c15eda0 2023-06-23T18:49:56.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== osd.4 v2:172.21.15.81:6800/933345311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4c3c0729d0 con 0x7f4c3c06fed0 2023-06-23T18:49:56.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7f0ae1d9b640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0ac40662b0 0x7f0ac4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7ff76125f640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7ff74006ff30 0x7ff740072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f0ac406ff80 0x7f0ac40723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.026+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== osd.6 v2:172.21.15.81:6816/3000886383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f18c4072a00 con 0x7f18c406ff00 2023-06-23T18:49:56.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7ff761a60640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff7400663d0 0x7ff740068880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff758006cb0 tx=0x7ff758009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7ff76125f640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7ff74006ff30 0x7ff740072360 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7f0ae2d9d640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f0ac406ff80 0x7f0ac40723b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7f0ae1d9b640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0ac40662b0 0x7f0ac4068760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4078a10 tx=0x7f0ae408c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== osd.2 v2:172.21.15.38:6808/1605176588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0ac4072a80 con 0x7f0ac406ff80 2023-06-23T18:49:56.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.030+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== osd.5 v2:172.21.15.81:6808/3054646995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff740072a30 con 0x7ff74006ff30 2023-06-23T18:49:56.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 --> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f452404dfe0 con 0x7f450806feb0 2023-06-23T18:49:56.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 --> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0adc0d45a0 con 0x7f0ac406ff80 2023-06-23T18:49:56.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f4519ffb640 1 -- 172.21.15.38:0/502650432 <== osd.0 v2:172.21.15.38:6818/575541123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f452404dfe0 con 0x7f450806feb0 2023-06-23T18:49:56.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ad2ffd640 1 -- 172.21.15.38:0/966406064 <== osd.2 v2:172.21.15.38:6808/1605176588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0adc0d45a0 con 0x7f0ac406ff80 2023-06-23T18:49:56.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f450806feb0 msgr2=0x7f45080722e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f450806feb0 0x7f45080722e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f0ac406ff80 msgr2=0x7f0ac40723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f0ac406ff80 0x7f0ac40723b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4508066350 msgr2=0x7f4508068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4508066350 0x7f4508068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45200af000 tx=0x7f4520008040 comp rx=0 tx=0).stop 2023-06-23T18:49:56.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 msgr2=0x7f45241e9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 --2- 172.21.15.38:0/502650432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45240696d0 0x7f45241e9d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c7d0 tx=0x7f451c00cbd0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f4529cd0640 1 -- 172.21.15.38:0/502650432 reap_dead start 2023-06-23T18:49:56.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 shutdown_connections 2023-06-23T18:49:56.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 >> 172.21.15.38:0/502650432 conn(0x7f45240bc670 msgr2=0x7f452414cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0ac40662b0 msgr2=0x7f0ac4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0ac40662b0 0x7f0ac4068760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4078a10 tx=0x7f0ae408c040 comp rx=0 tx=0).stop 2023-06-23T18:49:56.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 shutdown_connections 2023-06-23T18:49:56.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f452b733640 1 -- 172.21.15.38:0/502650432 wait complete. 2023-06-23T18:49:56.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc03e880 msgr2=0x7f0adc03d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.046+0000 7f0ae359e640 1 --2- 172.21.15.38:0/966406064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc03e880 0x7f0adc03d8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800c460 tx=0x7f0ad800c920 comp rx=0 tx=0).stop 2023-06-23T18:49:56.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f0ae2d9d640 1 -- 172.21.15.38:0/966406064 reap_dead start 2023-06-23T18:49:56.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 --> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22380dfa80 con 0x7f222c06ffa0 2023-06-23T18:49:56.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 shutdown_connections 2023-06-23T18:49:56.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 >> 172.21.15.38:0/966406064 conn(0x7f0adc04b170 msgr2=0x7f0adc02aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f2227fff640 1 -- 172.21.15.38:0/2414870239 <== osd.1 v2:172.21.15.38:6800/978431787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22380dfa80 con 0x7f222c06ffa0 2023-06-23T18:49:56.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 shutdown_connections 2023-06-23T18:49:56.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f0ae359e640 1 -- 172.21.15.38:0/966406064 wait complete. 2023-06-23T18:49:56.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f222c06ffa0 msgr2=0x7f222c0723d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f222c06ffa0 0x7f222c0723d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f222c0662d0 msgr2=0x7f222c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f222c0662d0 0x7f222c068780 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f223001a040 tx=0x7f22300a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238043310 msgr2=0x7f2238171b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 --2- 172.21.15.38:0/2414870239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238043310 0x7f2238171b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f223400e820 tx=0x7f223400ece0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223f7fe640 1 -- 172.21.15.38:0/2414870239 reap_dead start 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 shutdown_connections 2023-06-23T18:49:56.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 >> 172.21.15.38:0/2414870239 conn(0x7f2238043920 msgr2=0x7f223802b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 shutdown_connections 2023-06-23T18:49:56.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 --> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ccc06f7c0 con 0x7f6cb806ffa0 2023-06-23T18:49:56.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f223ffff640 1 -- 172.21.15.38:0/2414870239 wait complete. 2023-06-23T18:49:56.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f6cb37fe640 1 -- 172.21.15.38:0/1151125062 <== osd.3 v2:172.21.15.38:6816/1363740470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ccc06f7c0 con 0x7f6cb806ffa0 2023-06-23T18:49:56.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.050+0000 7f7266b92640 1 -- 172.21.15.38:0/1457570756 --> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7258045f80 con 0x7f724406ffd0 2023-06-23T18:49:56.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f6cb806ffa0 msgr2=0x7f6cb80723d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f725d7fa640 1 -- 172.21.15.38:0/1457570756 <== osd.7 v2:172.21.15.81:6824/3767203985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f724c009580 con 0x7f724406ffd0 2023-06-23T18:49:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f6cb806ffa0 0x7f6cb80723d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 --> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c38002cc0 con 0x7f4c3c06fed0 2023-06-23T18:49:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 --> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18e00b9990 con 0x7f18c406ff00 2023-06-23T18:49:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c4e7fc640 1 -- 172.21.15.38:0/2832631236 <== osd.4 v2:172.21.15.81:6800/933345311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c38002cc0 con 0x7f4c3c06fed0 2023-06-23T18:49:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7f4c3c06fed0 msgr2=0x7f4c3c072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7f4c3c06fed0 0x7f4c3c072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4c3c066280 msgr2=0x7f4c3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4c3c066280 0x7f4c3c068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c540114b0 tx=0x7f4c54009190 comp rx=0 tx=0).stop 2023-06-23T18:49:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50043310 msgr2=0x7f4c500dbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f18d67fc640 1 -- 172.21.15.38:0/4054666827 <== osd.6 v2:172.21.15.81:6816/3000886383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18e00b9990 con 0x7f18c406ff00 2023-06-23T18:49:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 --2- 172.21.15.38:0/2832631236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4c50043310 0x7f4c500dbb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c5804f130 tx=0x7f4c58093d60 comp rx=0 tx=0).stop 2023-06-23T18:49:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c5e33c640 1 -- 172.21.15.38:0/2832631236 reap_dead start 2023-06-23T18:49:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 shutdown_connections 2023-06-23T18:49:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 >> 172.21.15.38:0/2832631236 conn(0x7f4c50043920 msgr2=0x7f4c5002be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6cb8066350 msgr2=0x7f6cb8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6cb8066350 0x7f6cb8068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0011f0 tx=0x7f6cbc009040 comp rx=0 tx=0).stop 2023-06-23T18:49:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 shutdown_connections 2023-06-23T18:49:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.054+0000 7f4c43fff640 1 -- 172.21.15.38:0/2832631236 wait complete. 2023-06-23T18:49:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 msgr2=0x7f6ccc0be390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f6cd14f3640 1 --2- 172.21.15.38:0/1151125062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ccc14ba30 0x7f6ccc0be390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40b0040 tx=0x7f6cc4019660 comp rx=0 tx=0).stop 2023-06-23T18:49:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f6ccb7fe640 1 -- 172.21.15.38:0/1151125062 reap_dead start 2023-06-23T18:49:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 shutdown_connections 2023-06-23T18:49:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 >> 172.21.15.38:0/1151125062 conn(0x7f6ccc0c0050 msgr2=0x7f6ccc13e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f18c406ff00 msgr2=0x7f18c4072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f18c406ff00 0x7f18c4072330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f18c40662b0 msgr2=0x7f18c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f18c40662b0 0x7f18c4068760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0ad000 tx=0x7f18dc0a6000 comp rx=0 tx=0).stop 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 msgr2=0x7f18e014fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 --2- 172.21.15.38:0/4054666827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e0070ef0 0x7f18e014fec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18d0016fa0 tx=0x7f18d0014550 comp rx=0 tx=0).stop 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e611e640 1 -- 172.21.15.38:0/4054666827 reap_dead start 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 shutdown_connections 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 >> 172.21.15.38:0/4054666827 conn(0x7f18e00bc670 msgr2=0x7f18e006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 shutdown_connections 2023-06-23T18:49:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.058+0000 7f18e7b81640 1 -- 172.21.15.38:0/4054666827 wait complete. 2023-06-23T18:49:56.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f724406ffd0 msgr2=0x7f7244072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f724406ffd0 0x7f7244072400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 shutdown_connections 2023-06-23T18:49:56.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7244066300 msgr2=0x7f72440687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7244066300 0x7f72440687b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72580076d0 tx=0x7f7260122070 comp rx=0 tx=0).stop 2023-06-23T18:49:56.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 msgr2=0x7f7258039810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 --2- 172.21.15.38:0/1457570756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7258043f20 0x7f7258039810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f725400b3e0 tx=0x7f725400b8a0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f726512f640 1 -- 172.21.15.38:0/1457570756 reap_dead start 2023-06-23T18:49:56.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 shutdown_connections 2023-06-23T18:49:56.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 >> 172.21.15.38:0/1457570756 conn(0x7f72580479e0 msgr2=0x7f7258005d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f6cd14f3640 1 -- 172.21.15.38:0/1151125062 wait complete. 2023-06-23T18:49:56.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 shutdown_connections 2023-06-23T18:49:56.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7f724affd640 1 -- 172.21.15.38:0/1457570756 wait complete. 2023-06-23T18:49:56.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 --> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff75c04dfe0 con 0x7ff74006ff30 2023-06-23T18:49:56.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff7527fc640 1 -- 172.21.15.38:0/2986952324 <== osd.5 v2:172.21.15.81:6808/3054646995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff75c04dfe0 con 0x7ff74006ff30 2023-06-23T18:49:56.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7ff74006ff30 msgr2=0x7ff740072360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7ff74006ff30 0x7ff740072360 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff7400663d0 msgr2=0x7ff740068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff7400663d0 0x7ff740068880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff758006cb0 tx=0x7ff758009240 comp rx=0 tx=0).stop 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 msgr2=0x7ff75c083b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.062+0000 7ff762a62640 1 --2- 172.21.15.38:0/2986952324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff75c15eda0 0x7ff75c083b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b0040 tx=0x7ff754019630 comp rx=0 tx=0).stop 2023-06-23T18:49:56.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.070+0000 7ff762261640 1 -- 172.21.15.38:0/2986952324 reap_dead start 2023-06-23T18:49:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.070+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 shutdown_connections 2023-06-23T18:49:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.070+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 >> 172.21.15.38:0/2986952324 conn(0x7ff75c0bc690 msgr2=0x7ff75c0be950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.078+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 shutdown_connections 2023-06-23T18:49:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.078+0000 7ff762a62640 1 -- 172.21.15.38:0/2986952324 wait complete. 2023-06-23T18:49:56.151 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:56.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-23T18:49:56.152 INFO:teuthology.orchestra.run.smithi038.stdout:64424509448 2023-06-23T18:49:56.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-23T18:49:56.153 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:56.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-23T18:49:56.154 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:56.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-23T18:49:56.155 INFO:teuthology.orchestra.run.smithi038.stdout:60129542153 2023-06-23T18:49:56.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-23T18:49:56.156 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:56.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-23T18:49:56.158 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:56.158 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-23T18:49:56.159 INFO:teuthology.orchestra.run.smithi038.stdout:55834574857 2023-06-23T18:49:56.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-23T18:49:56.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 Processor -- start 2023-06-23T18:49:56.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 -- start start 2023-06-23T18:49:56.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff57c06fe80 0x7ff57c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff57c06f690 0x7ff57c0bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0ba950 con 0x7ff57c149c70 2023-06-23T18:49:56.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0a4560 con 0x7ff57c06fe80 2023-06-23T18:49:56.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff581137640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0a3b00 con 0x7ff57c06f690 2023-06-23T18:49:56.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff57c06fe80 0x7ff57c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff57c06fe80 0x7ff57c0a35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50984/0 (socket says 172.21.15.38:50984) 2023-06-23T18:49:56.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 -- 172.21.15.38:0/3256342157 learned_addr learned my addr 172.21.15.38:0/3256342157 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff580936640 1 --2- 172.21.15.38:0/3256342157 >> v2:172.21.15.81:3300/0 conn(0x7ff57c06f690 0x7ff57c0bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 -- 172.21.15.38:0/3256342157 >> v2:172.21.15.81:3300/0 conn(0x7ff57c06f690 msgr2=0x7ff57c0bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 --2- 172.21.15.38:0/3256342157 >> v2:172.21.15.81:3300/0 conn(0x7ff57c06f690 0x7ff57c0bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 -- 172.21.15.38:0/3256342157 >> v1:172.21.15.81:6789/0 conn(0x7ff57c149c70 legacy=0x7ff57c14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff57b7fe640 1 -- 172.21.15.38:0/3256342157 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c070360 con 0x7ff57c06fe80 2023-06-23T18:49:56.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 Processor -- start 2023-06-23T18:49:56.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 -- start start 2023-06-23T18:49:56.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12400b62c0 0x7f12400be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124014bcb0 con 0x7f124014a8d0 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124014f310 con 0x7f124006d930 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f12451d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124006f610 con 0x7f12400b62c0 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f124014a8d0 0x7f124006ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39604/0 (socket says 172.21.15.38:39604) 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123ed9d640 1 -- 172.21.15.38:0/2529311760 learned_addr learned my addr 172.21.15.38:0/2529311760 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123f59e640 1 --2- 172.21.15.38:0/2529311760 >> v2:172.21.15.81:3300/0 conn(0x7f12400b62c0 0x7f12400be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451534113 0 0) 0x7f124014bcb0 con 0x7f124014a8d0 2023-06-23T18:49:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f122c003530 con 0x7f124014a8d0 2023-06-23T18:49:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3255503749 0 0) 0x7f122c003530 con 0x7f124014a8d0 2023-06-23T18:49:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 >> v2:172.21.15.81:3300/0 conn(0x7f12400b62c0 msgr2=0x7f12400be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 --2- 172.21.15.38:0/2529311760 >> v2:172.21.15.81:3300/0 conn(0x7f12400b62c0 0x7f12400be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 >> v1:172.21.15.81:6789/0 conn(0x7f124006d930 legacy=0x7f124014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240071050 con 0x7f124014a8d0 2023-06-23T18:49:56.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff9030c2640 1 Processor -- start 2023-06-23T18:49:56.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f1230001680 con 0x7f124014a8d0 2023-06-23T18:49:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 >> v1:172.21.15.38:6789/0 conn(0x7f124014a8d0 legacy=0x7f124006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff57b7fe640 1 --2- 172.21.15.38:0/3256342157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06fe80 0x7ff57c0a35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0bccc0 tx=0x7ff56c01e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6a5356a9625e72 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c003980 0x7f122c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 0x7f122c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7f123e59c640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c005180 0x7f122c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124006f610 con 0x7f122c0047d0 2023-06-23T18:49:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c00bfe0 con 0x7f122c003980 2023-06-23T18:49:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c00c1a0 con 0x7f122c005180 2023-06-23T18:49:56.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 Processor -- start 2023-06-23T18:49:56.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 -- start start 2023-06-23T18:49:56.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff57affd640 1 -- 172.21.15.38:0/3256342157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c004230 con 0x7ff57c06fe80 2023-06-23T18:49:56.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff57affd640 1 -- 172.21.15.38:0/3256342157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0ab070 con 0x7ff57c06fe80 2023-06-23T18:49:56.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff57affd640 1 -- 172.21.15.38:0/3256342157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0a7810 con 0x7ff57c06fe80 2023-06-23T18:49:56.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123f59e640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c005180 0x7f122c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 0x7f122c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123ed9d640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c003980 0x7f122c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 -- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c005180 msgr2=0x7f122c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c005180 0x7f122c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 -- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c003980 msgr2=0x7f122c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c003980 0x7f122c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f6469c22640 1 Processor -- start 2023-06-23T18:49:56.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f123f59e640 1 -- 172.21.15.38:0/2529311760 reap_dead start 2023-06-23T18:49:56.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f1237fff640 1 -- 172.21.15.38:0/2529311760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c003530 con 0x7f122c0047d0 2023-06-23T18:49:56.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f6469c22640 1 -- start start 2023-06-23T18:49:56.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2c0069f60 0x7fc2c00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.330+0000 7ff9030c2640 1 -- start start 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff9030c2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 0x7ff8fc070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff9030c2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 0x7ff8fc13a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff9030c2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc13b310 con 0x7ff8fc13aa50 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff9030c2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc153520 con 0x7ff8fc13b580 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff9030c2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc06b0c0 con 0x7ff8fc0702a0 2023-06-23T18:49:56.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc2c006dcb0 0x7fc2c006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c014ab40 con 0x7fc2c006f230 2023-06-23T18:49:56.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c0070d00 con 0x7fc2c006dcb0 2023-06-23T18:49:56.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bffff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c014ae20 con 0x7fc2c0069f60 2023-06-23T18:49:56.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 Processor -- start 2023-06-23T18:49:56.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- 172.21.15.38:0/3256342157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06fe80 msgr2=0x7ff57c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 --2- 172.21.15.38:0/3256342157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06fe80 0x7ff57c0a35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0bccc0 tx=0x7ff56c01e920 comp rx=0 tx=0).stop 2023-06-23T18:49:56.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff8fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 0x7ff8fc13a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff900e5e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 0x7ff8fc070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- 172.21.15.38:0/3256342157 shutdown_connections 2023-06-23T18:49:56.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 --2- 172.21.15.38:0/3256342157 >> v2:172.21.15.81:3300/0 conn(0x7ff57c06f690 0x7ff57c0bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 --2- 172.21.15.38:0/3256342157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06fe80 0x7ff57c0a35c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- 172.21.15.38:0/3256342157 >> 172.21.15.38:0/3256342157 conn(0x7ff57c0c1160 msgr2=0x7ff57c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- 172.21.15.38:0/3256342157 shutdown_connections 2023-06-23T18:49:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- 172.21.15.38:0/3256342157 wait complete. 2023-06-23T18:49:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff8fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 0x7ff8fc13a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34224/0 (socket says 172.21.15.38:34224) 2023-06-23T18:49:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff8fbfff640 1 -- 172.21.15.38:0/1804432674 learned_addr learned my addr 172.21.15.38:0/1804432674 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc2c006dcb0 0x7fc2c006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc2c006dcb0 0x7fc2c006e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51006/0 (socket says 172.21.15.38:51006) 2023-06-23T18:49:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2be7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2c006f230 0x7fc2c01471d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:54992/0 (socket says 172.21.15.38:54992) 2023-06-23T18:49:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 -- start start 2023-06-23T18:49:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 -- 172.21.15.38:0/1241045774 learned_addr learned my addr 172.21.15.38:0/1241045774 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2beffd640 1 --2- 172.21.15.38:0/1241045774 >> v2:172.21.15.81:3300/0 conn(0x7fc2c0069f60 0x7fc2c00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff8fb7fe640 1 -- 172.21.15.38:0/1804432674 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842382115 0 0) 0x7ff8fc13b310 con 0x7ff8fc13aa50 2023-06-23T18:49:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff8fb7fe640 1 -- 172.21.15.38:0/1804432674 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e4003530 con 0x7ff8fc13aa50 2023-06-23T18:49:56.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 -- 172.21.15.38:0/1241045774 >> v2:172.21.15.81:3300/0 conn(0x7fc2c0069f60 msgr2=0x7fc2c00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 --2- 172.21.15.38:0/1241045774 >> v2:172.21.15.81:3300/0 conn(0x7fc2c0069f60 0x7fc2c00b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 -- 172.21.15.38:0/1241045774 >> v1:172.21.15.81:6789/0 conn(0x7fc2c006f230 legacy=0x7fc2c01471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7fc2bf7fe640 1 -- 172.21.15.38:0/1241045774 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c014b2d0 con 0x7fc2c006dcb0 2023-06-23T18:49:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff900e5e640 1 -- 172.21.15.38:0/1804432674 >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 msgr2=0x7ff8fc13a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff900e5e640 1 --2- 172.21.15.38:0/1804432674 >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 0x7ff8fc13a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff900e5e640 1 -- 172.21.15.38:0/1804432674 >> v1:172.21.15.81:6789/0 conn(0x7ff8fc13aa50 legacy=0x7ff8fc1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff900e5e640 1 -- 172.21.15.38:0/1804432674 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc06b3a0 con 0x7ff8fc0702a0 2023-06-23T18:49:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d6c0d17e0 0x7f2d6c044160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c02cd50 con 0x7f2d6c0d5340 2023-06-23T18:49:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c0d5e60 con 0x7f2d6c006ed0 2023-06-23T18:49:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d737fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d6c0d17e0 0x7f2d6c044160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d788b8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c0d6140 con 0x7f2d6c0d17e0 2023-06-23T18:49:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 Processor -- start 2023-06-23T18:49:56.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d737fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d6c0d17e0 0x7f2d6c044160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51014/0 (socket says 172.21.15.38:51014) 2023-06-23T18:49:56.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7f2d737fe640 1 -- 172.21.15.38:0/1787747192 learned_addr learned my addr 172.21.15.38:0/1787747192 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f2d737fe640 1 -- 172.21.15.38:0/1787747192 >> v1:172.21.15.81:6789/0 conn(0x7f2d6c006ed0 legacy=0x7f2d6c041d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f2d737fe640 1 -- 172.21.15.38:0/1787747192 >> v1:172.21.15.38:6789/0 conn(0x7f2d6c0d5340 legacy=0x7f2d6c0dc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f2d737fe640 1 -- 172.21.15.38:0/1787747192 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c042490 con 0x7f2d6c0d17e0 2023-06-23T18:49:56.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.334+0000 7ff581137640 1 -- start start 2023-06-23T18:49:56.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c06fe80 0x7ff57c1e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff57c149c70 0x7ff57c140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c14d1b0 con 0x7ff57c06f690 2023-06-23T18:49:56.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c13d970 con 0x7ff57c06fe80 2023-06-23T18:49:56.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c143660 con 0x7ff57c149c70 2023-06-23T18:49:56.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1237fff640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 0x7f122c004c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f122800ebb0 tx=0x7f1228020950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eb870f9033abd2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51018/0 (socket says 172.21.15.38:51018) 2023-06-23T18:49:56.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 -- 172.21.15.38:0/822861280 learned_addr learned my addr 172.21.15.38:0/822861280 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800e2d0 con 0x7f122c0047d0 2023-06-23T18:49:56.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280050d0 con 0x7f122c0047d0 2023-06-23T18:49:56.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f123e59c640 1 -- 172.21.15.38:0/2529311760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228005460 con 0x7f122c0047d0 2023-06-23T18:49:56.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57b7fe640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c06fe80 0x7ff57c1e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff580936640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff57c149c70 0x7ff57c140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff900e5e640 1 --2- 172.21.15.38:0/1804432674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 0x7ff8fc070670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eee468adef9e68f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 -- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff57c149c70 msgr2=0x7ff57c140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff57c149c70 0x7ff57c140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 -- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c06fe80 msgr2=0x7ff57c1e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c06fe80 0x7ff57c1e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 -- 172.21.15.38:0/822861280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c00b780 con 0x7ff57c06f690 2023-06-23T18:49:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff8fb7fe640 1 -- 172.21.15.38:0/1804432674 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0ab600 con 0x7ff8fc0702a0 2023-06-23T18:49:56.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff57bfff640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c500 tx=0x7ff57000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f12451d7640 1 -- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 msgr2=0x7f122c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f12451d7640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 0x7f122c004c40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f122800ebb0 tx=0x7f1228020950 comp rx=0 tx=0).stop 2023-06-23T18:49:56.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6469c22640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64640bee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6469c22640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64640c0c00 0x7f6464151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6469c22640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640c3050 con 0x7f64640a33a0 2023-06-23T18:49:56.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6469c22640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640bf3b0 con 0x7f64640c0c00 2023-06-23T18:49:56.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6469c22640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64640c32a0 con 0x7f64640beaa0 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6462ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f64640a33a0 0x7f64640c2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39624/0 (socket says 172.21.15.38:39624) 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6462ffd640 1 -- 172.21.15.38:0/206433005 learned_addr learned my addr 172.21.15.38:0/206433005 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f64637fe640 1 --2- 172.21.15.38:0/206433005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64640bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f6463fff640 1 --2- 172.21.15.38:0/206433005 >> v2:172.21.15.81:3300/0 conn(0x7f64640c0c00 0x7f6464151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f64637fe640 1 -- 172.21.15.38:0/206433005 >> v2:172.21.15.81:3300/0 conn(0x7f64640c0c00 msgr2=0x7f6464151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f64637fe640 1 --2- 172.21.15.38:0/206433005 >> v2:172.21.15.81:3300/0 conn(0x7f64640c0c00 0x7f6464151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f64637fe640 1 -- 172.21.15.38:0/206433005 >> v1:172.21.15.38:6789/0 conn(0x7f64640a33a0 legacy=0x7f64640c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f64637fe640 1 -- 172.21.15.38:0/206433005 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640aa170 con 0x7f64640beaa0 2023-06-23T18:49:56.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bf7fe640 1 --2- 172.21.15.38:0/1241045774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c006e0f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2c006d1e0 tx=0x7fc2b001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19984607d1dab238 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bdffb640 1 -- 172.21.15.38:0/1241045774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00ac600 con 0x7fc2c006dcb0 2023-06-23T18:49:56.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bdffb640 1 -- 172.21.15.38:0/1241045774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b00a8050 con 0x7fc2c006dcb0 2023-06-23T18:49:56.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bdffb640 1 -- 172.21.15.38:0/1241045774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00ac980 con 0x7fc2c006dcb0 2023-06-23T18:49:56.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff8fb7fe640 1 -- 172.21.15.38:0/1804432674 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0a7050 con 0x7ff8fc0702a0 2023-06-23T18:49:56.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff8fb7fe640 1 -- 172.21.15.38:0/1804432674 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0ab960 con 0x7ff8fc0702a0 2023-06-23T18:49:56.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 -- 172.21.15.38:0/1804432674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 msgr2=0x7ff8fc070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 --2- 172.21.15.38:0/1804432674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 0x7ff8fc070670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec01c3b0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 -- 172.21.15.38:0/1804432674 shutdown_connections 2023-06-23T18:49:56.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 --2- 172.21.15.38:0/1804432674 >> v2:172.21.15.81:3300/0 conn(0x7ff8fc13b580 0x7ff8fc13a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 --2- 172.21.15.38:0/1804432674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc0702a0 0x7ff8fc070670 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec01c3b0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 -- 172.21.15.38:0/1804432674 >> 172.21.15.38:0/1804432674 conn(0x7ff8fc0c1fb0 msgr2=0x7ff8fc0c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f2d737fe640 1 --2- 172.21.15.38:0/1787747192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d17e0 0x7f2d6c044160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000bb10 tx=0x7f2d6001e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d4b0597dbb2780 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 -- 172.21.15.38:0/1241045774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 msgr2=0x7fc2c006e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 --2- 172.21.15.38:0/1241045774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c006e0f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2c006d1e0 tx=0x7fc2b001c420 comp rx=0 tx=0).stop 2023-06-23T18:49:56.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570005220 con 0x7ff57c06f690 2023-06-23T18:49:56.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 -- 172.21.15.38:0/1241045774 shutdown_connections 2023-06-23T18:49:56.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 --2- 172.21.15.38:0/1241045774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c006e0f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 --2- 172.21.15.38:0/1241045774 >> v2:172.21.15.81:3300/0 conn(0x7fc2c0069f60 0x7fc2c00b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 -- 172.21.15.38:0/1241045774 >> 172.21.15.38:0/1241045774 conn(0x7fc2c006aef0 msgr2=0x7fc2c006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 -- 172.21.15.38:0/822861280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c14e6b0 con 0x7ff57c06f690 2023-06-23T18:49:56.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff581137640 1 -- 172.21.15.38:0/822861280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c146be0 con 0x7ff57c06f690 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 -- 172.21.15.38:0/1241045774 shutdown_connections 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7fc2bffff640 1 -- 172.21.15.38:0/1241045774 wait complete. 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570005380 con 0x7ff57c06f690 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570007270 con 0x7ff57c06f690 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff581137640 1 -- 172.21.15.38:0/822861280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c005260 con 0x7ff57c06f690 2023-06-23T18:49:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5700073d0 con 0x7ff57c06f690 2023-06-23T18:49:56.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f64637fe640 1 --2- 172.21.15.38:0/206433005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64640bee70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64540097c0 tx=0x7f645401c130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22c4b14a3394c45a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 -- 172.21.15.38:0/1804432674 shutdown_connections 2023-06-23T18:49:56.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7ff9030c2640 1 -- 172.21.15.38:0/1804432674 wait complete. 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 Processor -- start 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 -- start start 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8fc13aa50 0x7ff8fc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8fc15c470 0x7ff8fc1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc15c290 con 0x7ff8fc15c470 2023-06-23T18:49:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc129170 con 0x7ff8fc13aa50 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff9030c2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc157580 con 0x7ff8fc13b580 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49448/0 (socket says 172.21.15.38:49448) 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 -- 172.21.15.38:0/3614076529 learned_addr learned my addr 172.21.15.38:0/3614076529 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff900e5e640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8fc13aa50 0x7ff8fc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 -- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8fc13aa50 msgr2=0x7ff8fc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8fc13aa50 0x7ff8fc155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 -- 172.21.15.38:0/3614076529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8fc15c470 msgr2=0x7ff8fc1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8fc15c470 0x7ff8fc1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff8fbfff640 1 -- 172.21.15.38:0/3614076529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009420 con 0x7ff8fc13b580 2023-06-23T18:49:56.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 Processor -- start 2023-06-23T18:49:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 -- start start 2023-06-23T18:49:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 0x7f1f3c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1f3c0bba10 0x7f1f3c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c0bbe60 con 0x7f1f3c1536f0 2023-06-23T18:49:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0bb7f0 con 0x7f1f3c0bba10 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f42c94640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0bc0b0 con 0x7f1f3c0baff0 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f41231640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1f3c1536f0 0x7f1f3c151b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39626/0 (socket says 172.21.15.38:39626) 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f41231640 1 -- 172.21.15.38:0/2386358155 learned_addr learned my addr 172.21.15.38:0/2386358155 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f1f40a30640 1 --2- 172.21.15.38:0/2386358155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 0x7f1f3c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f1f40a30640 1 -- 172.21.15.38:0/2386358155 >> v2:172.21.15.38:3300/0 conn(0x7f1f3c0bba10 msgr2=0x7f1f3c1531b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:49:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f1f3b7fe640 1 -- 172.21.15.38:0/2386358155 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032260270 0 0) 0x7f1f3c0bbe60 con 0x7f1f3c1536f0 2023-06-23T18:49:56.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f12451d7640 1 -- 172.21.15.38:0/2529311760 shutdown_connections 2023-06-23T18:49:56.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f12451d7640 1 --2- 172.21.15.38:0/2529311760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c0047d0 0x7f122c004c40 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f122800ebb0 tx=0x7f1228020950 comp rx=0 tx=0).stop 2023-06-23T18:49:56.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.338+0000 7f12451d7640 1 -- 172.21.15.38:0/2529311760 >> 172.21.15.38:0/2529311760 conn(0x7f12400c1ba0 msgr2=0x7f12400bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- 172.21.15.38:0/2529311760 shutdown_connections 2023-06-23T18:49:56.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- 172.21.15.38:0/2529311760 wait complete. 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 Processor -- start 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- start start 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f12401e73b0 0x7f12400a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 0x7f12401de940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 0x7f12401495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240148940 con 0x7f12401484d0 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400a6080 con 0x7f1240149170 2023-06-23T18:49:56.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f12451d7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400a5da0 con 0x7f12401e73b0 2023-06-23T18:49:56.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f123f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 0x7f12401495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f123f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 0x7f12401495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34262/0 (socket says 172.21.15.38:34262) 2023-06-23T18:49:56.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f123f59e640 1 -- 172.21.15.38:0/2318574944 learned_addr learned my addr 172.21.15.38:0/2318574944 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7f123ed9d640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f12401e73b0 0x7f12400a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 Processor -- start 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 -- start start 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c006f230 0x7fc2c01e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0143050 con 0x7fc2c006dcb0 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c013cef0 con 0x7fc2c006f230 2023-06-23T18:49:56.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0137440 con 0x7fc2c0069f60 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49440/0 (socket says 172.21.15.38:49440) 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 -- 172.21.15.38:0/404489153 learned_addr learned my addr 172.21.15.38:0/404489153 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2be7fc640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 -- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c006f230 msgr2=0x7fc2c01e40d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c006f230 0x7fc2c01e40d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 -- 172.21.15.38:0/404489153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 msgr2=0x7fc2c013c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c013c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 -- 172.21.15.38:0/404489153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00094d0 con 0x7fc2c0069f60 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2beffd640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400d7d0 tx=0x7fc2b400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400b6c0 con 0x7fc2c0069f60 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b400b820 con 0x7fc2c0069f60 2023-06-23T18:49:56.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c00bda00 con 0x7fc2c0069f60 2023-06-23T18:49:56.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff578ff9640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 0x7ff568068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5700832f0 con 0x7ff57c06f690 2023-06-23T18:49:56.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff57b7fe640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 0x7ff568068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f64627fc640 1 -- 172.21.15.38:0/206433005 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540ab600 con 0x7f64640beaa0 2023-06-23T18:49:56.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff8fbfff640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000e7f0 tx=0x7ff8f000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1f3bfff640 1 --2- 172.21.15.38:0/2386358155 >> v2:172.21.15.38:3300/0 conn(0x7f1f3c0bba10 0x7f1f3c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 0x7f12401de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.342+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400bbb0 con 0x7fc2c0069f60 2023-06-23T18:49:56.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c0137690 con 0x7fc2c0069f60 2023-06-23T18:49:56.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 -- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f12401e73b0 msgr2=0x7f12400a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f12401e73b0 0x7f12400a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 -- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 msgr2=0x7f12401495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 0x7f12401495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 -- 172.21.15.38:0/2318574944 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12401f41d0 con 0x7f12401484d0 2023-06-23T18:49:56.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d727fc640 1 -- 172.21.15.38:0/1787747192 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600a7a80 con 0x7f2d6c0d17e0 2023-06-23T18:49:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d727fc640 1 -- 172.21.15.38:0/1787747192 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d600a7be0 con 0x7f2d6c0d17e0 2023-06-23T18:49:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d727fc640 1 -- 172.21.15.38:0/1787747192 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600af440 con 0x7f2d6c0d17e0 2023-06-23T18:49:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c004dfe0 con 0x7fc2c0069f60 2023-06-23T18:49:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f64627fc640 1 -- 172.21.15.38:0/206433005 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64540a7050 con 0x7f64640beaa0 2023-06-23T18:49:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f64627fc640 1 -- 172.21.15.38:0/206433005 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540ab9c0 con 0x7f64640beaa0 2023-06-23T18:49:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 -- 172.21.15.38:0/206433005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 msgr2=0x7f64640bee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 --2- 172.21.15.38:0/206433005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64640bee70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64540097c0 tx=0x7f645401c130 comp rx=0 tx=0).stop 2023-06-23T18:49:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0009580 con 0x7ff8fc13b580 2023-06-23T18:49:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 -- 172.21.15.38:0/206433005 shutdown_connections 2023-06-23T18:49:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 --2- 172.21.15.38:0/206433005 >> v2:172.21.15.81:3300/0 conn(0x7f64640c0c00 0x7f6464151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 --2- 172.21.15.38:0/206433005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64640bee70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 -- 172.21.15.38:0/206433005 >> 172.21.15.38:0/206433005 conn(0x7f64640a5d80 msgr2=0x7f64640a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d788b8640 1 -- 172.21.15.38:0/1787747192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d17e0 msgr2=0x7f2d6c044160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d788b8640 1 --2- 172.21.15.38:0/1787747192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d17e0 0x7f2d6c044160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000bb10 tx=0x7f2d6001e9d0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1237fff640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 0x7f12401de940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1228004000 tx=0x7f122c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d788b8640 1 -- 172.21.15.38:0/1787747192 shutdown_connections 2023-06-23T18:49:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d788b8640 1 --2- 172.21.15.38:0/1787747192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d17e0 0x7f2d6c044160 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000bb10 tx=0x7f2d6001e9d0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f2d788b8640 1 -- 172.21.15.38:0/1787747192 >> 172.21.15.38:0/1787747192 conn(0x7f2d6c0479e0 msgr2=0x7f2d6c043810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 -- 172.21.15.38:0/206433005 shutdown_connections 2023-06-23T18:49:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2b400bd10 con 0x7fc2c0069f60 2023-06-23T18:49:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1f40a30640 1 --2- 172.21.15.38:0/2386358155 >> v2:172.21.15.38:3300/0 conn(0x7f1f3c0bba10 0x7f1f3c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 Processor -- start 2023-06-23T18:49:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1f40a30640 1 -- 172.21.15.38:0/2386358155 >> v1:172.21.15.38:6789/0 conn(0x7f1f3c1536f0 legacy=0x7f1f3c151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 -- start start 2023-06-23T18:49:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f000c940 con 0x7ff8fc13b580 2023-06-23T18:49:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000ccf0 con 0x7ff8fc13b580 2023-06-23T18:49:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f1f40a30640 1 -- 172.21.15.38:0/2386358155 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0bc3b0 con 0x7f1f3c0baff0 2023-06-23T18:49:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc154d00 con 0x7ff8fc13b580 2023-06-23T18:49:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc15bf40 con 0x7ff8fc13b580 2023-06-23T18:49:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc155cc0 con 0x7ff8fc13b580 2023-06-23T18:49:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2a77fe640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 0x7fc2ac068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2b4084f20 con 0x7fc2c0069f60 2023-06-23T18:49:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 0x7f21540a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7fc2be7fc640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 0x7fc2ac068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 0x7f21540c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2154152830 con 0x7f21540bee10 2023-06-23T18:49:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540c22a0 con 0x7f21540a30c0 2023-06-23T18:49:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f215b34a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21540c2870 con 0x7f21540bea40 2023-06-23T18:49:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f21588e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 0x7f21540c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f21588e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 0x7f21540c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51050/0 (socket says 172.21.15.38:51050) 2023-06-23T18:49:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f21588e5640 1 -- 172.21.15.38:0/474761494 learned_addr learned my addr 172.21.15.38:0/474761494 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f21590e6640 1 --2- 172.21.15.38:0/474761494 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 0x7f21540a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7ff57b7fe640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 0x7ff568068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b1000 tx=0x7ff56c0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.346+0000 7f6469c22640 1 -- 172.21.15.38:0/206433005 wait complete. 2023-06-23T18:49:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 Processor -- start 2023-06-23T18:49:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f21590e6640 1 -- 172.21.15.38:0/474761494 >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 msgr2=0x7f21540c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f21590e6640 1 --2- 172.21.15.38:0/474761494 >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 0x7f21540c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f21590e6640 1 -- 172.21.15.38:0/474761494 >> v1:172.21.15.38:6789/0 conn(0x7f21540bee10 legacy=0x7f215406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f21590e6640 1 -- 172.21.15.38:0/474761494 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540b7950 con 0x7f21540bea40 2023-06-23T18:49:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 -- start start 2023-06-23T18:49:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7fc2be7fc640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 0x7fc2ac068780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0143620 tx=0x7fc2b80063e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- 172.21.15.38:0/1787747192 shutdown_connections 2023-06-23T18:49:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64640a33a0 0x7f64640b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64640c0c00 0x7f64641e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640ba810 con 0x7f64640c0c00 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640baaf0 con 0x7f64640a33a0 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6469c22640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64641e9fe0 con 0x7f64640beaa0 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f64637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64640a33a0 0x7f64640b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49472/0 (socket says 172.21.15.38:49472) 2023-06-23T18:49:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 -- 172.21.15.38:0/3695995397 learned_addr learned my addr 172.21.15.38:0/3695995397 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f1f40a30640 1 --2- 172.21.15.38:0/2386358155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 0x7f1f3c06e150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097c0 tx=0x7f1f3001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab99b5cf427a380b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 -- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64640a33a0 msgr2=0x7f64640b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64640a33a0 0x7f64640b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 -- 172.21.15.38:0/3695995397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64640c0c00 msgr2=0x7f64641e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64640c0c00 0x7f64641e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 -- 172.21.15.38:0/3695995397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454009420 con 0x7f64640beaa0 2023-06-23T18:49:56.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f21590e6640 1 --2- 172.21.15.38:0/474761494 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 0x7f21540a35f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7530e965ea6023 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- 172.21.15.38:0/1787747192 wait complete. 2023-06-23T18:49:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 Processor -- start 2023-06-23T18:49:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f6462ffd640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f645800c4d0 tx=0x7f645800c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- start start 2023-06-23T18:49:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228007230 con 0x7f12401484d0 2023-06-23T18:49:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122800d070 con 0x7f12401484d0 2023-06-23T18:49:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228007610 con 0x7f12401484d0 2023-06-23T18:49:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401dee80 con 0x7f12401484d0 2023-06-23T18:49:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5700504a0 con 0x7ff57c06f690 2023-06-23T18:49:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12400a5110 con 0x7f12401484d0 2023-06-23T18:49:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2d6c006ed0 0x7f2d6c0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c176900 0x7f2d6c17a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c03c2a0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c178230 con 0x7f2d6c176900 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d788b8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0d0c90 con 0x7f2d6c006ed0 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51068/0 (socket says 172.21.15.38:51068) 2023-06-23T18:49:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f2d72ffd640 1 -- 172.21.15.38:0/3228130250 learned_addr learned my addr 172.21.15.38:0/3228130250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.350+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400a5ee0 con 0x7f12401484d0 2023-06-23T18:49:56.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d737fe640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2d6c006ed0 0x7f2d6c0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d73fff640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c176900 0x7f2d6c17a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 -- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2d6c006ed0 msgr2=0x7f2d6c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2d6c006ed0 0x7f2d6c0d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 -- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c176900 msgr2=0x7f2d6c17a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c176900 0x7f2d6c17a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 -- 172.21.15.38:0/3228130250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6000b770 con 0x7f2d6c0d5340 2023-06-23T18:49:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d72ffd640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d74072680 tx=0x7f2d74067700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12280067e0 con 0x7f12401484d0 2023-06-23T18:49:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7406a9b0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f12377fe640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 0x7f1220068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f122811ca70 con 0x7f12401484d0 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f123ed9d640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 0x7f1220068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f123ed9d640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 0x7f1220068780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1230008af0 tx=0x7f1230001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c1771d0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c03dac0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7406ab50 con 0x7f2d6c0d5340 2023-06-23T18:49:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740711c0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.354+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54005260 con 0x7f2d6c0d5340 2023-06-23T18:49:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12400a5ee0 con 0x7f12401484d0 2023-06-23T18:49:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d74071320 con 0x7f2d6c0d5340 2023-06-23T18:49:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7f2d5ffff640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 0x7f2d58068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d740fcf10 con 0x7f2d6c0d5340 2023-06-23T18:49:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7f2d737fe640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 0x7f2d58068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.358+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2b4052120 con 0x7fc2c0069f60 2023-06-23T18:49:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458005cf0 con 0x7f64640beaa0 2023-06-23T18:49:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f214bfff640 1 -- 172.21.15.38:0/474761494 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440ab600 con 0x7f21540bea40 2023-06-23T18:49:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f2d737fe640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 0x7f2d58068780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d600b1000 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646414d920 con 0x7f64640beaa0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64641e6dc0 con 0x7f64640beaa0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458005e50 con 0x7f64640beaa0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f3b7fe640 1 -- 172.21.15.38:0/2386358155 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300ab670 con 0x7f1f3c0baff0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f3b7fe640 1 -- 172.21.15.38:0/2386358155 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f300ab7d0 con 0x7f1f3c0baff0 2023-06-23T18:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f3b7fe640 1 -- 172.21.15.38:0/2386358155 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300abb60 con 0x7f1f3c0baff0 2023-06-23T18:49:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458007270 con 0x7f64640beaa0 2023-06-23T18:49:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646404d790 con 0x7f64640beaa0 2023-06-23T18:49:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- 172.21.15.38:0/2386358155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 msgr2=0x7f1f3c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 --2- 172.21.15.38:0/2386358155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 0x7f1f3c06e150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097c0 tx=0x7f1f3001c450 comp rx=0 tx=0).stop 2023-06-23T18:49:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f214bfff640 1 -- 172.21.15.38:0/474761494 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21440a7050 con 0x7f21540bea40 2023-06-23T18:49:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f214bfff640 1 -- 172.21.15.38:0/474761494 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440ab980 con 0x7f21540bea40 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- 172.21.15.38:0/2386358155 shutdown_connections 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 --2- 172.21.15.38:0/2386358155 >> v2:172.21.15.38:3300/0 conn(0x7f1f3c0bba10 0x7f1f3c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 --2- 172.21.15.38:0/2386358155 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0baff0 0x7f1f3c06e150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- 172.21.15.38:0/2386358155 >> 172.21.15.38:0/2386358155 conn(0x7f1f3c0c0050 msgr2=0x7f1f3c0c0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- 172.21.15.38:0/2386358155 shutdown_connections 2023-06-23T18:49:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8f0013470 con 0x7ff8fc13b580 2023-06-23T18:49:56.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- 172.21.15.38:0/2386358155 wait complete. 2023-06-23T18:49:56.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7ff8f97fa640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 0x7ff8e8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff8f00847c0 con 0x7ff8fc13b580 2023-06-23T18:49:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7ff900e5e640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 0x7ff8e8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 -- 172.21.15.38:0/474761494 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 msgr2=0x7f21540a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 --2- 172.21.15.38:0/474761494 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 0x7f21540a35f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 -- 172.21.15.38:0/474761494 shutdown_connections 2023-06-23T18:49:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 --2- 172.21.15.38:0/474761494 >> v2:172.21.15.38:3300/0 conn(0x7f21540a30c0 0x7f21540c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 --2- 172.21.15.38:0/474761494 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540bea40 0x7f21540a35f0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c3f0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 -- 172.21.15.38:0/474761494 >> 172.21.15.38:0/474761494 conn(0x7f21540a5cc0 msgr2=0x7f21540a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d740ca110 con 0x7f2d6c0d5340 2023-06-23T18:49:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 -- 172.21.15.38:0/474761494 shutdown_connections 2023-06-23T18:49:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f215b34a640 1 -- 172.21.15.38:0/474761494 wait complete. 2023-06-23T18:49:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7ff900e5e640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 0x7ff8e8068780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0ad000 tx=0x7ff8ec0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 Processor -- start 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.362+0000 7f1f42c94640 1 -- start start 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3c0baff0 0x7f1f3c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0bba10 0x7f1f3c12cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c14f6f0 con 0x7f1f3c1536f0 2023-06-23T18:49:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c13da80 con 0x7f1f3c0baff0 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0bf2a0 con 0x7f1f3c0bba10 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51076/0 (socket says 172.21.15.38:51076) 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 -- 172.21.15.38:0/1200655443 learned_addr learned my addr 172.21.15.38:0/1200655443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f3bfff640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0bba10 0x7f1f3c12cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 Processor -- start 2023-06-23T18:49:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 -- start start 2023-06-23T18:49:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 -- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0bba10 msgr2=0x7f1f3c12cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0bba10 0x7f1f3c12cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 -- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3c0baff0 msgr2=0x7f1f3c150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3c0baff0 0x7f1f3c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 -- 172.21.15.38:0/1200655443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009420 con 0x7f1f3c1536f0 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f41231640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c780 tx=0x7f1f3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400ce30 con 0x7f1f3c1536f0 2023-06-23T18:49:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400a640 con 0x7f1f3c1536f0 2023-06-23T18:49:56.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400a9f0 con 0x7f1f3c1536f0 2023-06-23T18:49:56.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c1508f0 con 0x7f1f3c1536f0 2023-06-23T18:49:56.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c14f940 con 0x7f1f3c1536f0 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540a30c0 0x7f21540b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 0x7f21540ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21540b9cb0 con 0x7f21540bee10 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21541eeb00 con 0x7f2154148bf0 2023-06-23T18:49:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f215b34a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21540babe0 con 0x7f21540a30c0 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51084/0 (socket says 172.21.15.38:51084) 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 -- 172.21.15.38:0/227705001 learned_addr learned my addr 172.21.15.38:0/227705001 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21590e6640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540a30c0 0x7f21540b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21598e7640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 0x7f21540ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 -- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540a30c0 msgr2=0x7f21540b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540a30c0 0x7f21540b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 -- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 msgr2=0x7f21540ba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 0x7f21540ba6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 -- 172.21.15.38:0/227705001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009420 con 0x7f21540bee10 2023-06-23T18:49:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21598e7640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 0x7f21540ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f21588e5640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f215000e890 tx=0x7f215000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.366+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c150610 con 0x7f1f3c1536f0 2023-06-23T18:49:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150009620 con 0x7f21540bee10 2023-06-23T18:49:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215000c940 con 0x7f21540bee10 2023-06-23T18:49:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000ccf0 con 0x7f21540bee10 2023-06-23T18:49:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21540a2c80 con 0x7f21540bee10 2023-06-23T18:49:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21540a50b0 con 0x7f21540bee10 2023-06-23T18:49:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215404d790 con 0x7f21540bee10 2023-06-23T18:49:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f3400ab50 con 0x7f1f3c1536f0 2023-06-23T18:49:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f1f397fa640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 0x7f1f20068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f34083830 con 0x7f1f3c1536f0 2023-06-23T18:49:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f1f40a30640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 0x7f1f20068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.370+0000 7f1f40a30640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 0x7f1f20068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f300af000 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8f0051a70 con 0x7ff8fc13b580 2023-06-23T18:49:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2150013470 con 0x7f21540bee10 2023-06-23T18:49:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64580073d0 con 0x7f64640beaa0 2023-06-23T18:49:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f644bfff640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 0x7f6450068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6458083c30 con 0x7f64640beaa0 2023-06-23T18:49:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f2149ffb640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 0x7f2138068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2150084770 con 0x7f21540bee10 2023-06-23T18:49:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f21590e6640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 0x7f2138068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.374+0000 7f21590e6640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 0x7f2138068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21440ad000 tx=0x7f21440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.378+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21500555b0 con 0x7f21540bee10 2023-06-23T18:49:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.378+0000 7f64637fe640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 0x7f6450068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:56.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.378+0000 7f64637fe640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 0x7f6450068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64540ad000 tx=0x7f64540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:56.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.386+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f3c150610 con 0x7f1f3c1536f0 2023-06-23T18:49:56.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.386+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6458050ee0 con 0x7f64640beaa0 2023-06-23T18:49:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.662+0000 7ff581137640 1 -- 172.21.15.38:0/822861280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff55c005510 con 0x7ff57c06f690 2023-06-23T18:49:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.662+0000 7ff578ff9640 1 -- 172.21.15.38:0/822861280 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff570053ac0 con 0x7ff57c06f690 2023-06-23T18:49:56.669 INFO:teuthology.orchestra.run.smithi038.stdout:64424509448 2023-06-23T18:49:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2d540057e0 con 0x7f2d6c0d5340 2023-06-23T18:49:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 msgr2=0x7ff568068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 0x7ff568068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0b1000 tx=0x7ff56c0a9070 comp rx=0 tx=0).stop 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 msgr2=0x7ff57c1464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff57000c500 tx=0x7ff57000c9c0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 shutdown_connections 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff5680662b0 0x7ff568068760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff57c149c70 0x7ff57c140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c06fe80 0x7ff57c1e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 --2- 172.21.15.38:0/822861280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff57c06f690 0x7ff57c1464d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 >> 172.21.15.38:0/822861280 conn(0x7ff57c0c1160 msgr2=0x7ff57c147630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 shutdown_connections 2023-06-23T18:49:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7f2d5ffff640 1 -- 172.21.15.38:0/3228130250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d740cd730 con 0x7f2d6c0d5340 2023-06-23T18:49:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:56.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.666+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f12400a5ee0 con 0x7f12401484d0 2023-06-23T18:49:56.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12377fe640 1 -- 172.21.15.38:0/2318574944 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12400a5ee0 con 0x7f12401484d0 2023-06-23T18:49:56.674 INFO:teuthology.orchestra.run.smithi038.stdout:60129542152 2023-06-23T18:49:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 msgr2=0x7f2d58068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 0x7f2d58068780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d600b1000 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2023-06-23T18:49:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 msgr2=0x7f2d6c1763c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d74072680 tx=0x7f2d74067700 comp rx=0 tx=0).stop 2023-06-23T18:49:56.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7ff5627fc640 1 -- 172.21.15.38:0/822861280 wait complete. 2023-06-23T18:49:56.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 shutdown_connections 2023-06-23T18:49:56.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2d580662d0 0x7f2d58068780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c176900 0x7f2d6c17a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d6c0d5340 0x7f2d6c1763c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 --2- 172.21.15.38:0/3228130250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2d6c006ed0 0x7f2d6c0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 >> 172.21.15.38:0/3228130250 conn(0x7f2d6c0479e0 msgr2=0x7f2d6c005d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 shutdown_connections 2023-06-23T18:49:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f2d788b8640 1 -- 172.21.15.38:0/3228130250 wait complete. 2023-06-23T18:49:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 msgr2=0x7f1220068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 0x7f1220068780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1230008af0 tx=0x7f1230001e30 comp rx=0 tx=0).stop 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 msgr2=0x7f12401de940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 0x7f12401de940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1228004000 tx=0x7f122c005800 comp rx=0 tx=0).stop 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 shutdown_connections 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f12200662d0 0x7f1220068780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1240149170 0x7f12401495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12401484d0 0x7f12401de940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 --2- 172.21.15.38:0/2318574944 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f12401e73b0 0x7f12400a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 >> 172.21.15.38:0/2318574944 conn(0x7f12400c1ba0 msgr2=0x7f124014b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 shutdown_connections 2023-06-23T18:49:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.670+0000 7f12451d7640 1 -- 172.21.15.38:0/2318574944 wait complete. 2023-06-23T18:49:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.686+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2c00008e0 con 0x7fc2c0069f60 2023-06-23T18:49:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.686+0000 7fc2a77fe640 1 -- 172.21.15.38:0/404489153 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2b4055740 con 0x7fc2c0069f60 2023-06-23T18:49:56.690 INFO:teuthology.orchestra.run.smithi038.stdout:64424509447 2023-06-23T18:49:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 msgr2=0x7fc2ac068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 0x7fc2ac068780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0143620 tx=0x7fc2b80063e0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 msgr2=0x7fc2c01e3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400d7d0 tx=0x7fc2b400dc90 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 shutdown_connections 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc2ac0662d0 0x7fc2ac068780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c006f230 0x7fc2c01e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2c006dcb0 0x7fc2c013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 --2- 172.21.15.38:0/404489153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2c0069f60 0x7fc2c01e3950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 >> 172.21.15.38:0/404489153 conn(0x7fc2c006aef0 msgr2=0x7fc2c0146710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 shutdown_connections 2023-06-23T18:49:56.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7fc2bffff640 1 -- 172.21.15.38:0/404489153 wait complete. 2023-06-23T18:49:56.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21541523e0 con 0x7f21540bee10 2023-06-23T18:49:56.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.690+0000 7f2149ffb640 1 -- 172.21.15.38:0/227705001 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2150055140 con 0x7f21540bee10 2023-06-23T18:49:56.697 INFO:teuthology.orchestra.run.smithi038.stdout:64424509448 2023-06-23T18:49:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 msgr2=0x7f2138068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 0x7f2138068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21440ad000 tx=0x7f21440a6000 comp rx=0 tx=0).stop 2023-06-23T18:49:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 msgr2=0x7f21541ee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f215000e890 tx=0x7f215000ed50 comp rx=0 tx=0).stop 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 shutdown_connections 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2138066280 0x7f2138068730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2154148bf0 0x7f21540ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f21540bee10 0x7f21541ee5c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 --2- 172.21.15.38:0/227705001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f21540a30c0 0x7f21540b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 >> 172.21.15.38:0/227705001 conn(0x7f21540a5cc0 msgr2=0x7f2154149cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 shutdown_connections 2023-06-23T18:49:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7f215b34a640 1 -- 172.21.15.38:0/227705001 wait complete. 2023-06-23T18:49:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.694+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff8fc04d790 con 0x7ff8fc13b580 2023-06-23T18:49:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.698+0000 7ff8f97fa640 1 -- 172.21.15.38:0/3614076529 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8f0055090 con 0x7ff8fc13b580 2023-06-23T18:49:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.698+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1f3c150610 con 0x7f1f3c1536f0 2023-06-23T18:49:56.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2023-06-23T18:49:56.706 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f397fa640 1 -- 172.21.15.38:0/1200655443 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f3c150610 con 0x7f1f3c1536f0 2023-06-23T18:49:56.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2023-06-23T18:49:56.707 INFO:teuthology.orchestra.run.smithi038.stdout:55834574856 2023-06-23T18:49:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 msgr2=0x7f1f20068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 0x7f1f20068800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f300af000 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2023-06-23T18:49:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 msgr2=0x7f1f3c12d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c780 tx=0x7f1f3400cc40 comp rx=0 tx=0).stop 2023-06-23T18:49:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 shutdown_connections 2023-06-23T18:49:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1f20066350 0x7f1f20068800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f3c1536f0 0x7f1f3c12d220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f3c0bba10 0x7f1f3c12cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 --2- 172.21.15.38:0/1200655443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3c0baff0 0x7f1f3c150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 >> 172.21.15.38:0/1200655443 conn(0x7f1f3c0c0050 msgr2=0x7f1f3c142f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 msgr2=0x7ff8e8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 0x7ff8e8068780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0ad000 tx=0x7ff8ec0a6000 comp rx=0 tx=0).stop 2023-06-23T18:49:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 shutdown_connections 2023-06-23T18:49:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7f1f42c94640 1 -- 172.21.15.38:0/1200655443 wait complete. 2023-06-23T18:49:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 msgr2=0x7ff8fc1380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000e7f0 tx=0x7ff8f000ecb0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 shutdown_connections 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff8e80662d0 0x7ff8e8068780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8fc15c470 0x7ff8fc1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8fc13b580 0x7ff8fc1380a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 --2- 172.21.15.38:0/3614076529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8fc13aa50 0x7ff8fc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 >> 172.21.15.38:0/3614076529 conn(0x7ff8fc0c1fb0 msgr2=0x7ff8fc12b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 shutdown_connections 2023-06-23T18:49:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.702+0000 7ff9030c2640 1 -- 172.21.15.38:0/3614076529 wait complete. 2023-06-23T18:49:56.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2023-06-23T18:49:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.710+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64641ea120 con 0x7f64640beaa0 2023-06-23T18:49:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.710+0000 7f644bfff640 1 -- 172.21.15.38:0/3695995397 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64641ea120 con 0x7f64640beaa0 2023-06-23T18:49:56.714 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 msgr2=0x7f6450068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 0x7f6450068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64540ad000 tx=0x7f64540a6000 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 msgr2=0x7f64641e66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f645800c4d0 tx=0x7f645800c990 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 shutdown_connections 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6450066280 0x7f6450068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64640c0c00 0x7f64641e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64640beaa0 0x7f64641e66b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 --2- 172.21.15.38:0/3695995397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64640a33a0 0x7f64640b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 >> 172.21.15.38:0/3695995397 conn(0x7f64640a5d80 msgr2=0x7f646414e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:56.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 shutdown_connections 2023-06-23T18:49:56.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:56.714+0000 7f6469c22640 1 -- 172.21.15.38:0/3695995397 wait complete. 2023-06-23T18:49:56.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.0 2023-06-23T18:49:56.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2023-06-23T18:49:56.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2023-06-23T18:49:56.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-06-23T18:49:56.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2023-06-23T18:49:57.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-23T18:49:57.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-23T18:49:57.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-23T18:49:57.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-23T18:49:57.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-23T18:49:57.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-23T18:49:57.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-23T18:49:57.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-23T18:49:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.881+0000 7fabd9be9640 1 Processor -- start 2023-06-23T18:49:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.881+0000 7fabd9be9640 1 -- start start 2023-06-23T18:49:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd9be9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd9be9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd406e520 con 0x7fabd406c150 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd9be9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd4156580 con 0x7fabd4155940 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd9be9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd406e7e0 con 0x7fabd40bbf40 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd93e8640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fabd406c150 0x7fabd415ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39634/0 (socket says 172.21.15.38:39634) 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd93e8640 1 -- 172.21.15.38:0/406177852 learned_addr learned my addr 172.21.15.38:0/406177852 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd3fff640 1 --2- 172.21.15.38:0/406177852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768527348 0 0) 0x7fabd406e520 con 0x7fabd406c150 2023-06-23T18:49:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc003530 con 0x7fabd406c150 2023-06-23T18:49:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363769324 0 0) 0x7fabd4156580 con 0x7fabd4155940 2023-06-23T18:49:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd3fff640 1 -- 172.21.15.38:0/406177852 >> v1:172.21.15.81:6789/0 conn(0x7fabd4155940 legacy=0x7fabd406ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd3fff640 1 -- 172.21.15.38:0/406177852 >> v1:172.21.15.38:6789/0 conn(0x7fabd406c150 legacy=0x7fabd415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.885+0000 7fabd3fff640 1 -- 172.21.15.38:0/406177852 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4070830 con 0x7fabd40bbf40 2023-06-23T18:49:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd3fff640 1 --2- 172.21.15.38:0/406177852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd4155d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097f0 tx=0x7fabc401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6bf7ad70f38f3ea server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40ab650 con 0x7fabd40bbf40 2023-06-23T18:49:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc40ab7b0 con 0x7fabd40bbf40 2023-06-23T18:49:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd37fe640 1 -- 172.21.15.38:0/406177852 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40abb40 con 0x7fabd40bbf40 2023-06-23T18:49:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 -- 172.21.15.38:0/406177852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 msgr2=0x7fabd4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 --2- 172.21.15.38:0/406177852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd4155d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097f0 tx=0x7fabc401c450 comp rx=0 tx=0).stop 2023-06-23T18:49:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 -- 172.21.15.38:0/406177852 shutdown_connections 2023-06-23T18:49:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 --2- 172.21.15.38:0/406177852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd4155d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 -- 172.21.15.38:0/406177852 >> 172.21.15.38:0/406177852 conn(0x7fabd40bfbf0 msgr2=0x7fabd40bfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 -- 172.21.15.38:0/406177852 shutdown_connections 2023-06-23T18:49:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7fabd9be9640 1 -- 172.21.15.38:0/406177852 wait complete. 2023-06-23T18:49:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7f859a52b640 1 Processor -- start 2023-06-23T18:49:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 Processor -- start 2023-06-23T18:49:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.889+0000 7f859a52b640 1 -- start start 2023-06-23T18:49:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f859a52b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 0x7f859414a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f859a52b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940bbd30 con 0x7f85940696d0 2023-06-23T18:49:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f859a52b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940bc010 con 0x7f859406edf0 2023-06-23T18:49:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f859a52b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940bc4a0 con 0x7f859414a390 2023-06-23T18:49:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 -- start start 2023-06-23T18:49:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599529640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85940696d0 0x7f85941403a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39648/0 (socket says 172.21.15.38:39648) 2023-06-23T18:49:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599529640 1 -- 172.21.15.38:0/1393266408 learned_addr learned my addr 172.21.15.38:0/1393266408 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599d2a640 1 --2- 172.21.15.38:0/1393266408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 0x7f859414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 0x7fabd4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd4155940 0x7fabd41ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd414f600 con 0x7fabd406c150 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41e9ca0 con 0x7fabd4155940 2023-06-23T18:49:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd9be9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41edcb0 con 0x7fabd40bbf40 2023-06-23T18:49:57.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599d2a640 1 -- 172.21.15.38:0/1393266408 >> v1:172.21.15.81:6789/0 conn(0x7f859406edf0 legacy=0x7f8594149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599d2a640 1 -- 172.21.15.38:0/1393266408 >> v1:172.21.15.38:6789/0 conn(0x7f85940696d0 legacy=0x7f85941403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7f8599d2a640 1 -- 172.21.15.38:0/1393266408 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859414e020 con 0x7f859414a390 2023-06-23T18:49:57.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49528/0 (socket says 172.21.15.38:49528) 2023-06-23T18:49:57.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd3fff640 1 -- 172.21.15.38:0/4189568615 learned_addr learned my addr 172.21.15.38:0/4189568615 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 0x7fabd4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd93e8640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd4155940 0x7fabd41ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 -- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 msgr2=0x7fabd41ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 -- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd4155940 msgr2=0x7fabd41ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd4155940 0x7fabd41ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 -- 172.21.15.38:0/4189568615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009420 con 0x7fabd406c150 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd3fff640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.893+0000 7fabd8be7640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 0x7fabd4152ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00c780 tx=0x7fabcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc003db0 con 0x7fabd406c150 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd9be9640 1 -- 172.21.15.38:0/4189568615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd41edf90 con 0x7fabd406c150 2023-06-23T18:49:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd9be9640 1 -- 172.21.15.38:0/4189568615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd41eac00 con 0x7fabd406c150 2023-06-23T18:49:57.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7f8599d2a640 1 --2- 172.21.15.38:0/1393266408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 0x7f859414a810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f858400a990 tx=0x7f858401d2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c7c2326c1eb8aa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00ce30 con 0x7fabd406c150 2023-06-23T18:49:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc005290 con 0x7fabd406c150 2023-06-23T18:49:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.897+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabcc0054b0 con 0x7fabd406c150 2023-06-23T18:49:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7fabd9be9640 1 -- 172.21.15.38:0/4189568615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb4005260 con 0x7fabd406c150 2023-06-23T18:49:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7fabd17fa640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 0x7fabc00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabcc083900 con 0x7fabd406c150 2023-06-23T18:49:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7fabd3fff640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 0x7fabc00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7fabd3fff640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 0x7fabc00688b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c10 tx=0x7fabc40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7f858bfff640 1 -- 172.21.15.38:0/1393266408 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840a5aa0 con 0x7f859414a390 2023-06-23T18:49:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7f858bfff640 1 -- 172.21.15.38:0/1393266408 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85840a5c00 con 0x7f859414a390 2023-06-23T18:49:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7f859a52b640 1 -- 172.21.15.38:0/1393266408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 msgr2=0x7f859414a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.901+0000 7f859a52b640 1 --2- 172.21.15.38:0/1393266408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 0x7f859414a810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f858400a990 tx=0x7f858401d2b0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabcc050b20 con 0x7fabd406c150 2023-06-23T18:49:57.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7f859a52b640 1 -- 172.21.15.38:0/1393266408 shutdown_connections 2023-06-23T18:49:57.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7f859a52b640 1 --2- 172.21.15.38:0/1393266408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f859414a390 0x7f859414a810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7f859a52b640 1 -- 172.21.15.38:0/1393266408 >> 172.21.15.38:0/1393266408 conn(0x7f859406aef0 msgr2=0x7f859406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7f859a52b640 1 -- 172.21.15.38:0/1393266408 shutdown_connections 2023-06-23T18:49:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.909+0000 7f859a52b640 1 -- 172.21.15.38:0/1393266408 wait complete. 2023-06-23T18:49:57.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.913+0000 7f859a52b640 1 Processor -- start 2023-06-23T18:49:57.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.913+0000 7f859a52b640 1 -- start start 2023-06-23T18:49:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85940696d0 0x7f85940b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859406edf0 0x7f8594146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940b8310 con 0x7f859414a390 2023-06-23T18:49:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594146cb0 con 0x7f859406edf0 2023-06-23T18:49:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85941417b0 con 0x7f85940696d0 2023-06-23T18:49:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51104/0 (socket says 172.21.15.38:51104) 2023-06-23T18:49:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 -- 172.21.15.38:0/3980448250 learned_addr learned my addr 172.21.15.38:0/3980448250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599529640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85940696d0 0x7f85940b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8598d28640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859406edf0 0x7f8594146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 -- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85940696d0 msgr2=0x7f85940b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85940696d0 0x7f85940b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 -- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859406edf0 msgr2=0x7f8594146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859406edf0 0x7f8594146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 -- 172.21.15.38:0/3980448250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858400a5c0 con 0x7f859414a390 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8599d2a640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f858400a990 tx=0x7f858401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840b65f0 con 0x7f859414a390 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85840b6750 con 0x7f859414a390 2023-06-23T18:49:57.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85840b6ac0 con 0x7f859414a390 2023-06-23T18:49:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940b76f0 con 0x7f859414a390 2023-06-23T18:49:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.917+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8594147050 con 0x7f859414a390 2023-06-23T18:49:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.921+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85840b4040 con 0x7f859414a390 2023-06-23T18:49:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.921+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859404dfe0 con 0x7f859414a390 2023-06-23T18:49:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.921+0000 7f8589ffb640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 0x7f8578068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.921+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f858411de10 con 0x7f859414a390 2023-06-23T18:49:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.921+0000 7f8599529640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 0x7f8578068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.925+0000 7f8599529640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 0x7f8578068830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c10 tx=0x7f8590009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 Processor -- start 2023-06-23T18:49:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 -- start start 2023-06-23T18:49:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140c16e0 0x7f4b14149e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b140b6830 0x7f4b1414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b14070fe0 con 0x7f4b140bd430 2023-06-23T18:49:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b140b6eb0 con 0x7f4b140b6830 2023-06-23T18:49:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b1a34b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1414aa70 con 0x7f4b140c16e0 2023-06-23T18:49:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b140b6830 0x7f4b1414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b140b6830 0x7f4b1414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51110/0 (socket says 172.21.15.38:51110) 2023-06-23T18:49:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 -- 172.21.15.38:0/108978435 learned_addr learned my addr 172.21.15.38:0/108978435 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19349640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140c16e0 0x7f4b14149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 -- 172.21.15.38:0/108978435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140c16e0 msgr2=0x7f4b14149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140c16e0 0x7f4b14149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 -- 172.21.15.38:0/108978435 >> v1:172.21.15.81:6789/0 conn(0x7f4b140bd430 legacy=0x7f4b1414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f4b19b4a640 1 -- 172.21.15.38:0/108978435 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14070c70 con 0x7f4b140b6830 2023-06-23T18:49:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f89c5912640 1 Processor -- start 2023-06-23T18:49:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85840eb130 con 0x7f859414a390 2023-06-23T18:49:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f89c5912640 1 -- start start 2023-06-23T18:49:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f866f359640 1 Processor -- start 2023-06-23T18:49:57.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.929+0000 7f866f359640 1 -- start start 2023-06-23T18:49:57.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 Processor -- start 2023-06-23T18:49:57.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866f359640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86600069c0 0x7f86600457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866f359640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8660041a20 0x7f8660046530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866f359640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600414f0 con 0x7f8660041f90 2023-06-23T18:49:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866f359640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600426b0 con 0x7f86600069c0 2023-06-23T18:49:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866f359640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8660007380 con 0x7f8660041a20 2023-06-23T18:49:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86600069c0 0x7f86600457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86600069c0 0x7f86600457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51132/0 (socket says 172.21.15.38:51132) 2023-06-23T18:49:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 -- 172.21.15.38:0/3274120356 learned_addr learned my addr 172.21.15.38:0/3274120356 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f89c00bbb30 0x7f89c014e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c006e050 0x7f89c014af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c014e9b0 con 0x7f89c00bbb30 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c00bc690 con 0x7f89c006e050 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89c5912640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00baf50 con 0x7f89c00a4d30 2023-06-23T18:49:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c006e050 0x7f89c014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89c006e050 0x7f89c014af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34324/0 (socket says 172.21.15.38:34324) 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 -- 172.21.15.38:0/1960877867 learned_addr learned my addr 172.21.15.38:0/1960877867 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89beffd640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89be7fc640 1 --2- 172.21.15.38:0/1960877867 >> v2:172.21.15.38:3300/0 conn(0x7f89c00bbb30 0x7f89c014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 -- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 msgr2=0x7f89c00a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c00a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 -- 172.21.15.38:0/1960877867 >> v2:172.21.15.38:3300/0 conn(0x7f89c00bbb30 msgr2=0x7f89c014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 --2- 172.21.15.38:0/1960877867 >> v2:172.21.15.38:3300/0 conn(0x7f89c00bbb30 0x7f89c014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 -- 172.21.15.38:0/1960877867 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c006e660 con 0x7f89c006e050 2023-06-23T18:49:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 -- start start 2023-06-23T18:49:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 0x7f5cf006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 0x7f5cf014b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00bd020 con 0x7f5cf00b5b50 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00710e0 con 0x7f5cf014e290 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceffff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00bd2c0 con 0x7f5cf014e660 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cee7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5cf00b5b50 0x7f5cf006f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39662/0 (socket says 172.21.15.38:39662) 2023-06-23T18:49:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cee7fc640 1 -- 172.21.15.38:0/2955051352 learned_addr learned my addr 172.21.15.38:0/2955051352 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 -- 172.21.15.38:0/3274120356 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8660041a20 msgr2=0x7f8660046530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cef7fe640 1 --2- 172.21.15.38:0/2955051352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 0x7f5cf014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866db56640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8660041a20 0x7f8660046530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8660041a20 0x7f8660046530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 -- 172.21.15.38:0/3274120356 >> v1:172.21.15.81:6789/0 conn(0x7f8660041f90 legacy=0x7f86600d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f866e357640 1 -- 172.21.15.38:0/3274120356 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660041740 con 0x7f86600069c0 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5ceeffd640 1 --2- 172.21.15.38:0/2955051352 >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 0x7f5cf006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cedffb640 1 -- 172.21.15.38:0/2955051352 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514605868 0 0) 0x7f5cf00bd020 con 0x7f5cf00b5b50 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cedffb640 1 -- 172.21.15.38:0/2955051352 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd8005740 con 0x7f5cf00b5b50 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cef7fe640 1 -- 172.21.15.38:0/2955051352 >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 msgr2=0x7f5cf006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cef7fe640 1 --2- 172.21.15.38:0/2955051352 >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 0x7f5cf006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cef7fe640 1 -- 172.21.15.38:0/2955051352 >> v1:172.21.15.38:6789/0 conn(0x7f5cf00b5b50 legacy=0x7f5cf006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f5cef7fe640 1 -- 172.21.15.38:0/2955051352 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf014ee40 con 0x7f5cf014e660 2023-06-23T18:49:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f4b19b4a640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1414e0f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646686947c8293a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f4b0bfff640 1 -- 172.21.15.38:0/108978435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0a56e0 con 0x7f4b140b6830 2023-06-23T18:49:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f4b0bfff640 1 -- 172.21.15.38:0/108978435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0a5840 con 0x7f4b140b6830 2023-06-23T18:49:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f4b0bfff640 1 -- 172.21.15.38:0/108978435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0a5bd0 con 0x7f4b140b6830 2023-06-23T18:49:57.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.933+0000 7f89bf7fe640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c006e050 0x7f89c014af40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009bd0 tx=0x7f89b801cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a51818cb0dcb189 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89bdffb640 1 -- 172.21.15.38:0/1960877867 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80a5c00 con 0x7f89c006e050 2023-06-23T18:49:57.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89bdffb640 1 -- 172.21.15.38:0/1960877867 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c014e270 con 0x7f89c006e050 2023-06-23T18:49:57.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89bdffb640 1 -- 172.21.15.38:0/1960877867 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80ad3f0 con 0x7f89c006e050 2023-06-23T18:49:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f5ceeffd640 1 --2- 172.21.15.38:0/2955051352 >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 0x7f5cf006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 Processor -- start 2023-06-23T18:49:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 -- start start 2023-06-23T18:49:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa834041640 0x7fa8340432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- 172.21.15.38:0/108978435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 msgr2=0x7f4b1414e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1414e0f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c01ca10 comp rx=0 tx=0).stop 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- 172.21.15.38:0/108978435 shutdown_connections 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1414e0f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/108978435 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140c16e0 0x7f4b14149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- 172.21.15.38:0/108978435 >> 172.21.15.38:0/108978435 conn(0x7f4b1406b210 msgr2=0x7f4b140c0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8340462a0 0x7fa83402c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa834045200 con 0x7fa834046760 2023-06-23T18:49:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa834041e80 con 0x7fa834041640 2023-06-23T18:49:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa84175a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa834045e50 con 0x7fa8340462a0 2023-06-23T18:49:57.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- 172.21.15.38:0/108978435 shutdown_connections 2023-06-23T18:49:57.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 Processor -- start 2023-06-23T18:49:57.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- 172.21.15.38:0/108978435 wait complete. 2023-06-23T18:49:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8340462a0 0x7fa83402c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8340462a0 0x7fa83402c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:34338/0 (socket says 172.21.15.38:34338) 2023-06-23T18:49:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 -- 172.21.15.38:0/3041770194 learned_addr learned my addr 172.21.15.38:0/3041770194 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 -- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c006e050 msgr2=0x7f89c014af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c006e050 0x7f89c014af40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009bd0 tx=0x7f89b801cd50 comp rx=0 tx=0).stop 2023-06-23T18:49:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f5cef7fe640 1 --2- 172.21.15.38:0/2955051352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 0x7f5cf014b510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009d90 tx=0x7f5ce801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e99112e8c0fb7e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f5cedffb640 1 -- 172.21.15.38:0/2955051352 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80a5780 con 0x7f5cf014e660 2023-06-23T18:49:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83bfff640 1 --2- 172.21.15.38:0/3041770194 >> v2:172.21.15.38:3300/0 conn(0x7fa834041640 0x7fa8340432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 -- 172.21.15.38:0/3041770194 >> v2:172.21.15.38:3300/0 conn(0x7fa834041640 msgr2=0x7fa8340432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 --2- 172.21.15.38:0/3041770194 >> v2:172.21.15.38:3300/0 conn(0x7fa834041640 0x7fa8340432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 -- 172.21.15.38:0/3041770194 >> v1:172.21.15.38:6789/0 conn(0x7fa834046760 legacy=0x7fa8340067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7fa83b7fe640 1 -- 172.21.15.38:0/3041770194 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834045450 con 0x7fa8340462a0 2023-06-23T18:49:57.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 -- start start 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22500458d0 0x7f2250045ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2250049390 con 0x7f225002a4f0 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2250046c90 con 0x7f225004a230 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f225ca37640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2250049e10 con 0x7f22500458d0 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f2256ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f225002a4f0 0x7f2250047e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39678/0 (socket says 172.21.15.38:39678) 2023-06-23T18:49:57.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f2256ffd640 1 -- 172.21.15.38:0/1458384598 learned_addr learned my addr 172.21.15.38:0/1458384598 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f866e357640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86600069c0 0x7f86600457b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8658009870 tx=0x7f865801d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106cc26b66ed8813 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 -- 172.21.15.38:0/1960877867 shutdown_connections 2023-06-23T18:49:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c006e050 0x7f89c014af40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 --2- 172.21.15.38:0/1960877867 >> v2:172.21.15.38:3300/0 conn(0x7f89c00bbb30 0x7f89c014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 --2- 172.21.15.38:0/1960877867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c00a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 -- 172.21.15.38:0/1960877867 >> 172.21.15.38:0/1960877867 conn(0x7f89c00c0050 msgr2=0x7f89c00c0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22577fe640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22500458d0 0x7f2250045ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 -- 172.21.15.38:0/1960877867 shutdown_connections 2023-06-23T18:49:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f89c5912640 1 -- 172.21.15.38:0/1960877867 wait complete. 2023-06-23T18:49:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417210473 0 0) 0x7f2250049390 con 0x7f225002a4f0 2023-06-23T18:49:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248003530 con 0x7f225002a4f0 2023-06-23T18:49:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f5cedffb640 1 -- 172.21.15.38:0/2955051352 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80a58e0 con 0x7f5cf014e660 2023-06-23T18:49:57.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f5cedffb640 1 -- 172.21.15.38:0/2955051352 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80a5c50 con 0x7f5cf014e660 2023-06-23T18:49:57.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 Processor -- start 2023-06-23T18:49:57.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f4b1a34b640 1 -- start start 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794451815 0 0) 0x7f2250046c90 con 0x7f225004a230 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2250049390 con 0x7f225004a230 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332919788 0 0) 0x7f2248003530 con 0x7f225002a4f0 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22500458d0 msgr2=0x7f2250045ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22500458d0 0x7f2250045ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 >> v1:172.21.15.81:6789/0 conn(0x7f225004a230 legacy=0x7f2250028820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250028f30 con 0x7f225002a4f0 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f224c001680 con 0x7f225002a4f0 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.937+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 >> v1:172.21.15.38:6789/0 conn(0x7f225002a4f0 legacy=0x7f2250047e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2248003b40 0x7f2248003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480047d0 0x7f2248004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248005180 0x7f224800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250049e10 con 0x7f2248003b40 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224800bf30 con 0x7f22480047d0 2023-06-23T18:49:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224800c0f0 con 0x7f2248005180 2023-06-23T18:49:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f2256ffd640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480047d0 0x7f2248004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f2257fff640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248005180 0x7f224800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2248003b40 0x7f2248003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140bd430 0x7f4b141e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b140c16e0 0x7f4b141ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1414a3f0 con 0x7f4b140b6830 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1413cdc0 con 0x7f4b140c16e0 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1413d060 con 0x7f4b140bd430 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51156/0 (socket says 172.21.15.38:51156) 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 -- 172.21.15.38:0/1433695092 learned_addr learned my addr 172.21.15.38:0/1433695092 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b18b48640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140bd430 0x7f4b141e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19b4a640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b140c16e0 0x7f4b141ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866d355640 1 -- 172.21.15.38:0/3274120356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580ac600 con 0x7f86600069c0 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866d355640 1 -- 172.21.15.38:0/3274120356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580a8050 con 0x7f86600069c0 2023-06-23T18:49:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866d355640 1 -- 172.21.15.38:0/3274120356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580ac980 con 0x7f86600069c0 2023-06-23T18:49:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f89c5912640 1 Processor -- start 2023-06-23T18:49:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 -- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140bd430 msgr2=0x7f4b141e9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140bd430 0x7f4b141e9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 -- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b140c16e0 msgr2=0x7f4b141ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b140c16e0 0x7f4b141ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 -- 172.21.15.38:0/1433695092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009b30 con 0x7f4b140b6830 2023-06-23T18:49:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f89c5912640 1 -- start start 2023-06-23T18:49:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b19349640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000d5f0 tx=0x7f4b1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 -- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248005180 msgr2=0x7f224800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248005180 0x7f224800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 -- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480047d0 msgr2=0x7f2248004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480047d0 0x7f2248004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 -- 172.21.15.38:0/1458384598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248003530 con 0x7f2248003b40 2023-06-23T18:49:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f2256ffd640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480047d0 0x7f2248004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- 172.21.15.38:0/3274120356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86600069c0 msgr2=0x7f86600457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86600069c0 0x7f86600457b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8658009870 tx=0x7f865801d5e0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- 172.21.15.38:0/3274120356 shutdown_connections 2023-06-23T18:49:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8660041a20 0x7f8660046530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 --2- 172.21.15.38:0/3274120356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86600069c0 0x7f86600457b0 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8658009870 tx=0x7f865801d5e0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- 172.21.15.38:0/3274120356 >> 172.21.15.38:0/3274120356 conn(0x7f8660043920 msgr2=0x7f8660043cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- 172.21.15.38:0/3274120356 shutdown_connections 2023-06-23T18:49:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- 172.21.15.38:0/3274120356 wait complete. 2023-06-23T18:49:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100125f0 con 0x7f4b140b6830 2023-06-23T18:49:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b141eaae0 con 0x7f4b140b6830 2023-06-23T18:49:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1414e0f0 con 0x7f4b140b6830 2023-06-23T18:49:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10012750 con 0x7f4b140b6830 2023-06-23T18:49:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 -- 172.21.15.38:0/2955051352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 msgr2=0x7f5cf014b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 --2- 172.21.15.38:0/2955051352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 0x7f5cf014b510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009d90 tx=0x7f5ce801c8e0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100125f0 con 0x7f4b140b6830 2023-06-23T18:49:57.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f89c5912640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 -- 172.21.15.38:0/2955051352 shutdown_connections 2023-06-23T18:49:57.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 --2- 172.21.15.38:0/2955051352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e660 0x7f5cf014b510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 --2- 172.21.15.38:0/2955051352 >> v2:172.21.15.38:3300/0 conn(0x7f5cf014e290 0x7f5cf006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 -- 172.21.15.38:0/2955051352 >> 172.21.15.38:0/2955051352 conn(0x7f5cf00bd730 msgr2=0x7f5cf00bdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 Processor -- start 2023-06-23T18:49:57.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f866f359640 1 -- start start 2023-06-23T18:49:57.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51166/0 (socket says 172.21.15.38:51166) 2023-06-23T18:49:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f22577fe640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2248003b40 0x7f2248003f10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f225000f900 tx=0x7f224401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf707685032bb6b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.941+0000 7f5ceffff640 1 -- 172.21.15.38:0/2955051352 shutdown_connections 2023-06-23T18:49:57.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa83b7fe640 1 --2- 172.21.15.38:0/3041770194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8340462a0 0x7fa83402c000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa83400ca10 tx=0x7fa828020b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d974a2078aa41c36 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 -- 172.21.15.38:0/4179030206 learned_addr learned my addr 172.21.15.38:0/4179030206 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c006c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa83affd640 1 -- 172.21.15.38:0/3041770194 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280a9bf0 con 0x7fa8340462a0 2023-06-23T18:49:57.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c00bbb30 0x7f89c01f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa83affd640 1 -- 172.21.15.38:0/3041770194 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8280ad070 con 0x7fa8340462a0 2023-06-23T18:49:57.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa83affd640 1 -- 172.21.15.38:0/3041770194 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280b3400 con 0x7fa8340462a0 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8660041a20 0x7f86600c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86601759d0 0x7f8660171370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660172ec0 con 0x7f8660041f90 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c6680 con 0x7f8660041a20 2023-06-23T18:49:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8660025fa0 con 0x7f86601759d0 2023-06-23T18:49:57.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51180/0 (socket says 172.21.15.38:51180) 2023-06-23T18:49:57.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 -- 172.21.15.38:0/454106123 learned_addr learned my addr 172.21.15.38:0/454106123 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89be7fc640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c006c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89bf7fe640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c00bbb30 0x7f89c01f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c00b84b0 con 0x7f89c006e050 2023-06-23T18:49:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c01f3ee0 con 0x7f89c00bbb30 2023-06-23T18:49:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c006c6b0 con 0x7f89c00a4d30 2023-06-23T18:49:57.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 -- 172.21.15.38:0/3041770194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8340462a0 msgr2=0x7fa83402c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 --2- 172.21.15.38:0/3041770194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8340462a0 0x7fa83402c000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa83400ca10 tx=0x7fa828020b00 comp rx=0 tx=0).stop 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 -- 172.21.15.38:0/3041770194 shutdown_connections 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 --2- 172.21.15.38:0/3041770194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8340462a0 0x7fa83402c000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 --2- 172.21.15.38:0/3041770194 >> v2:172.21.15.38:3300/0 conn(0x7fa834041640 0x7fa8340432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 -- 172.21.15.38:0/3041770194 >> 172.21.15.38:0/3041770194 conn(0x7fa834043810 msgr2=0x7fa834043be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440ab400 con 0x7f2248003b40 2023-06-23T18:49:57.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440a7050 con 0x7f2248003b40 2023-06-23T18:49:57.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f22567fc640 1 -- 172.21.15.38:0/1458384598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440ab7e0 con 0x7f2248003b40 2023-06-23T18:49:57.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- 172.21.15.38:0/1458384598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2248003b40 msgr2=0x7f2248003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 --2- 172.21.15.38:0/1458384598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2248003b40 0x7f2248003f10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f225000f900 tx=0x7f224401c7f0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f2257fff640 1 -- 172.21.15.38:0/1458384598 reap_dead start 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866e357640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8660041a20 0x7f86600c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866eb58640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86601759d0 0x7f8660171370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 -- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86601759d0 msgr2=0x7f8660171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86601759d0 0x7f8660171370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 -- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8660041a20 msgr2=0x7f86600c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8660041a20 0x7f86600c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 -- 172.21.15.38:0/454106123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580094d0 con 0x7f8660041f90 2023-06-23T18:49:57.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 -- 172.21.15.38:0/2955051352 wait complete. 2023-06-23T18:49:57.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 Processor -- start 2023-06-23T18:49:57.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b100128c0 con 0x7f4b140b6830 2023-06-23T18:49:57.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f4b09ffb640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 0x7f4af80687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af4005260 con 0x7f4b140b6830 2023-06-23T18:49:57.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- 172.21.15.38:0/1458384598 shutdown_connections 2023-06-23T18:49:57.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- 172.21.15.38:0/1458384598 >> 172.21.15.38:0/1458384598 conn(0x7f225002da60 msgr2=0x7f225000e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:57.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866db56640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f866400c7f0 tx=0x7f866400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- 172.21.15.38:0/1458384598 shutdown_connections 2023-06-23T18:49:57.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 -- 172.21.15.38:0/3041770194 shutdown_connections 2023-06-23T18:49:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- 172.21.15.38:0/1458384598 wait complete. 2023-06-23T18:49:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f4b18b48640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 0x7f4af80687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664004220 con 0x7f8660041f90 2023-06-23T18:49:57.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664004380 con 0x7f8660041f90 2023-06-23T18:49:57.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 -- 172.21.15.38:0/454106123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86601718b0 con 0x7f8660041f90 2023-06-23T18:49:57.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7fa84175a640 1 -- 172.21.15.38:0/3041770194 wait complete. 2023-06-23T18:49:57.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 -- start start 2023-06-23T18:49:57.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cf00b5b50 0x7f5cf0148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf014e660 0x7f5cf00beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01f75b0 con 0x7f5cf00b5b50 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01489a0 con 0x7f5cf014e660 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5ceffff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf014cfe0 con 0x7f5cf014e290 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49634/0 (socket says 172.21.15.38:49634) 2023-06-23T18:49:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 -- 172.21.15.38:0/3573439818 learned_addr learned my addr 172.21.15.38:0/3573439818 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cef7fe640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf014e660 0x7f5cf00beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 Processor -- start 2023-06-23T18:49:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f4b18b48640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 0x7f4af80687f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b1414b840 tx=0x7f4b04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f225ca37640 1 -- start start 2023-06-23T18:49:57.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664003840 con 0x7f8660041f90 2023-06-23T18:49:57.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f866f359640 1 -- 172.21.15.38:0/454106123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600caee0 con 0x7f8660041f90 2023-06-23T18:49:57.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2250030670 0x7f2250029920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 -- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf014e660 msgr2=0x7f5cf00beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf014e660 0x7f5cf00beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 -- 172.21.15.38:0/3573439818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cf00b5b50 msgr2=0x7f5cf0148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cf00b5b50 0x7f5cf0148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f5cee7fc640 1 -- 172.21.15.38:0/3573439818 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009420 con 0x7f5cf014e290 2023-06-23T18:49:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 0x7f2250044a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250029e60 con 0x7f2250030670 2023-06-23T18:49:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225002ff50 con 0x7f225002fa90 2023-06-23T18:49:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f225ca37640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500d67d0 con 0x7f2248003b40 2023-06-23T18:49:57.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 Processor -- start 2023-06-23T18:49:57.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49640/0 (socket says 172.21.15.38:49640) 2023-06-23T18:49:57.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 -- 172.21.15.38:0/3746082215 learned_addr learned my addr 172.21.15.38:0/3746082215 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cee7fc640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c4d0 tx=0x7f5ce000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f2257fff640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 0x7f2250044a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0005cf0 con 0x7f5cf014e290 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5ceffff640 1 -- 172.21.15.38:0/3573439818 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8009a70 con 0x7f5cf014e290 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5ceffff640 1 -- 172.21.15.38:0/3573439818 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf014dd40 con 0x7f5cf014e290 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 -- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 msgr2=0x7f2250044a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 0x7f2250044a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 -- 172.21.15.38:0/3746082215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2250030670 msgr2=0x7f2250029920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2250030670 0x7f2250029920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 -- 172.21.15.38:0/3746082215 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250030210 con 0x7f2248003b40 2023-06-23T18:49:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f2257fff640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 0x7f2250044a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 -- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 msgr2=0x7f89c006c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c006c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 -- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c00bbb30 msgr2=0x7f89c01f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c00bbb30 0x7f89c01f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.945+0000 7f89beffd640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b8009830 con 0x7f89c006e050 2023-06-23T18:49:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f22577fe640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f224401d090 tx=0x7f2248005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89beffd640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89b000d860 tx=0x7f89b000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 -- start start 2023-06-23T18:49:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0005e50 con 0x7f5cf014e290 2023-06-23T18:49:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0007270 con 0x7f5cf014e290 2023-06-23T18:49:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5ceffff640 1 -- 172.21.15.38:0/3573439818 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd0005260 con 0x7f5cf014e290 2023-06-23T18:49:58.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 0x7fa83403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa834046760 0x7fa8340ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83403fa20 con 0x7fa8340462a0 2023-06-23T18:49:58.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83416d1e0 con 0x7fa834041640 2023-06-23T18:49:58.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa84175a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83416d4c0 con 0x7fa834046760 2023-06-23T18:49:58.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86640039a0 con 0x7f8660041f90 2023-06-23T18:49:58.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f865effd640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 0x7f8654068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8664083d60 con 0x7f8660041f90 2023-06-23T18:49:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51218/0 (socket says 172.21.15.38:51218) 2023-06-23T18:49:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 -- 172.21.15.38:0/4181122304 learned_addr learned my addr 172.21.15.38:0/4181122304 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:58.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83bfff640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 0x7fa83403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f866e357640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 0x7f8654068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f866f359640 1 -- 172.21.15.38:0/454106123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660175ee0 con 0x7f8660041f90 2023-06-23T18:49:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ce00073d0 con 0x7f5cf014e290 2023-06-23T18:49:58.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000c940 con 0x7f89c006e050 2023-06-23T18:49:58.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000caa0 con 0x7f89c006e050 2023-06-23T18:49:58.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c00b7df0 con 0x7f89c006e050 2023-06-23T18:49:58.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000ce10 con 0x7f89c006e050 2023-06-23T18:49:58.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c00b7a80 con 0x7f89c006e050 2023-06-23T18:49:58.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa840f59640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa834046760 0x7fa8340ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7f5cd7fff640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 0x7f5cdc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ce0083bf0 con 0x7f5cf014e290 2023-06-23T18:49:58.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f5ceeffd640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 0x7f5cdc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 -- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa834046760 msgr2=0x7fa8340ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c00b85f0 con 0x7f89c006e050 2023-06-23T18:49:58.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa834046760 0x7fa8340ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 -- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 msgr2=0x7fa83403adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 0x7fa83403adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83b7fe640 1 -- 172.21.15.38:0/4181122304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828008550 con 0x7fa8340462a0 2023-06-23T18:49:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.949+0000 7fa83bfff640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 0x7fa83403adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:58.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7fa83b7fe640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa82801e730 tx=0x7fa82801f340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f5ceeffd640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 0x7f5cdc068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006e90 tx=0x7f5ce4006de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f866e357640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 0x7f8654068910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86580ae000 tx=0x7f86580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b10058d90 con 0x7f4b140b6830 2023-06-23T18:49:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440abc80 con 0x7f2248003b40 2023-06-23T18:49:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440abde0 con 0x7f2248003b40 2023-06-23T18:49:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440b5630 con 0x7f2248003b40 2023-06-23T18:49:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2250175ba0 con 0x7f2248003b40 2023-06-23T18:49:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.953+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250045120 con 0x7f2248003b40 2023-06-23T18:49:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.957+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500d6990 con 0x7f2248003b40 2023-06-23T18:49:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.957+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8664050f60 con 0x7f8660041f90 2023-06-23T18:49:58.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.957+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280b3810 con 0x7fa8340462a0 2023-06-23T18:49:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83403de60 con 0x7fa8340462a0 2023-06-23T18:49:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83403d100 con 0x7fa8340462a0 2023-06-23T18:49:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89b0015410 con 0x7f89c006e050 2023-06-23T18:49:58.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834005280 con 0x7fa8340462a0 2023-06-23T18:49:58.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f89a7fff640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 0x7f89ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f89be7fc640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 0x7f89ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f89be7fc640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 0x7f89ac068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b7270 tx=0x7f89b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89b0058890 con 0x7f89c006e050 2023-06-23T18:49:58.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b10051950 con 0x7f4b140b6830 2023-06-23T18:49:58.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ce0050fa0 con 0x7f5cf014e290 2023-06-23T18:49:58.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8280b3970 con 0x7fa8340462a0 2023-06-23T18:49:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.961+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280b3d00 con 0x7fa8340462a0 2023-06-23T18:49:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.965+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22440b2050 con 0x7f2248003b40 2023-06-23T18:49:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.965+0000 7f2243fff640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 0x7f223c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.965+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f224411e300 con 0x7f2248003b40 2023-06-23T18:49:58.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.965+0000 7f2256ffd640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 0x7f223c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.969+0000 7f2256ffd640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 0x7f223c068830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f224c001210 tx=0x7f224c007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.969+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89b0050cc0 con 0x7f89c006e050 2023-06-23T18:49:58.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.973+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8280bd400 con 0x7fa8340462a0 2023-06-23T18:49:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.973+0000 7fa838ff9640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 0x7fa820068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.973+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa828123580 con 0x7fa8340462a0 2023-06-23T18:49:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.973+0000 7fa83bfff640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 0x7fa820068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.973+0000 7fa83bfff640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 0x7fa820068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa830009f50 tx=0x7fa830009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.977+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22440eb6d0 con 0x7f2248003b40 2023-06-23T18:49:58.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:57.977+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8280f07a0 con 0x7fa8340462a0 2023-06-23T18:49:58.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.225+0000 7fabd9be9640 1 -- 172.21.15.38:0/4189568615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fabb4005510 con 0x7fabd406c150 2023-06-23T18:49:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.225+0000 7fabd17fa640 1 -- 172.21.15.38:0/4189568615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabcc054140 con 0x7fabd406c150 2023-06-23T18:49:58.232 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:58.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 msgr2=0x7fabc00688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 0x7fabc00688b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c10 tx=0x7fabc40a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 msgr2=0x7fabd4152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 0x7fabd4152ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00c780 tx=0x7fabcc00cc40 comp rx=0 tx=0).stop 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 shutdown_connections 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fabc0066400 0x7fabc00688b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd4155940 0x7fabd41ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabd40bbf40 0x7fabd41ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 --2- 172.21.15.38:0/4189568615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd406c150 0x7fabd4152ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 >> 172.21.15.38:0/4189568615 conn(0x7fabd40bfbf0 msgr2=0x7fabd40bc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 shutdown_connections 2023-06-23T18:49:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.229+0000 7fabbaffd640 1 -- 172.21.15.38:0/4189568615 wait complete. 2023-06-23T18:49:58.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2023-06-23T18:49:58.257 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.253+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f859404dfe0 con 0x7f859414a390 2023-06-23T18:49:58.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.253+0000 7f8589ffb640 1 -- 172.21.15.38:0/3980448250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85840ba020 con 0x7f859414a390 2023-06-23T18:49:58.259 INFO:teuthology.orchestra.run.smithi038.stdout:60129542153 2023-06-23T18:49:58.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 msgr2=0x7f8578068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 0x7f8578068830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8590000c10 tx=0x7f8590009210 comp rx=0 tx=0).stop 2023-06-23T18:49:58.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 msgr2=0x7f859413e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f858400a990 tx=0x7f858401baf0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 shutdown_connections 2023-06-23T18:49:58.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8578066380 0x7f8578068830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f859414a390 0x7f859413e490 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859406edf0 0x7f8594146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 --2- 172.21.15.38:0/3980448250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85940696d0 0x7f85940b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 >> 172.21.15.38:0/3980448250 conn(0x7f859406aef0 msgr2=0x7f859406e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 shutdown_connections 2023-06-23T18:49:58.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.257+0000 7f859a52b640 1 -- 172.21.15.38:0/3980448250 wait complete. 2023-06-23T18:49:58.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.265+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4af40057e0 con 0x7f4b140b6830 2023-06-23T18:49:58.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.265+0000 7f4b09ffb640 1 -- 172.21.15.38:0/1433695092 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b10051af0 con 0x7f4b140b6830 2023-06-23T18:49:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 msgr2=0x7f4af80687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 0x7f4af80687f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b1414b840 tx=0x7f4b04009040 comp rx=0 tx=0).stop 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 msgr2=0x7f4b1413d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000d5f0 tx=0x7f4b1000dab0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 shutdown_connections 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4af8066340 0x7f4af80687f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b140c16e0 0x7f4b141ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b140bd430 0x7f4b141e9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 --2- 172.21.15.38:0/1433695092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b140b6830 0x7f4b1413d4f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 >> 172.21.15.38:0/1433695092 conn(0x7f4b1406b210 msgr2=0x7f4b14140af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 shutdown_connections 2023-06-23T18:49:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.269+0000 7f4b1a34b640 1 -- 172.21.15.38:0/1433695092 wait complete. 2023-06-23T18:49:58.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.273+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2250175d30 con 0x7f2248003b40 2023-06-23T18:49:58.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.273+0000 7f2243fff640 1 -- 172.21.15.38:0/3746082215 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22440eecf0 con 0x7f2248003b40 2023-06-23T18:49:58.278 INFO:teuthology.orchestra.run.smithi038.stdout:55834574857 2023-06-23T18:49:58.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.273+0000 7f5ceffff640 1 -- 172.21.15.38:0/3573439818 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5cd00057e0 con 0x7f5cf014e290 2023-06-23T18:49:58.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.273+0000 7f866f359640 1 -- 172.21.15.38:0/454106123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8660005390 con 0x7f8660041f90 2023-06-23T18:49:58.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f865effd640 1 -- 172.21.15.38:0/454106123 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f866401e070 con 0x7f8660041f90 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 msgr2=0x7f223c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 0x7f223c068830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f224c001210 tx=0x7f224c007b70 comp rx=0 tx=0).stop 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 msgr2=0x7f2250171850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f224401d090 tx=0x7f2248005800 comp rx=0 tx=0).stop 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 shutdown_connections 2023-06-23T18:49:58.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f223c066380 0x7f223c068830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225002fa90 0x7f2250044a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2250030670 0x7f2250029920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 --2- 172.21.15.38:0/3746082215 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2248003b40 0x7f2250171850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 >> 172.21.15.38:0/3746082215 conn(0x7f225002da60 msgr2=0x7f22500da1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 shutdown_connections 2023-06-23T18:49:58.284 INFO:teuthology.orchestra.run.smithi038.stdout:64424509448 2023-06-23T18:49:58.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f225ca37640 1 -- 172.21.15.38:0/3746082215 wait complete. 2023-06-23T18:49:58.285 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:58.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f5cd7fff640 1 -- 172.21.15.38:0/3573439818 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ce0017020 con 0x7f5cf014e290 2023-06-23T18:49:58.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 msgr2=0x7f8654068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 0x7f8654068910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86580ae000 tx=0x7f86580a7000 comp rx=0 tx=0).stop 2023-06-23T18:49:58.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.277+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 msgr2=0x7f8660170e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f866400c7f0 tx=0x7f866400ccb0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 msgr2=0x7f5cdc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 0x7f5cdc068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006e90 tx=0x7f5ce4006de0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 shutdown_connections 2023-06-23T18:49:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f8654066460 0x7f8654068910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86601759d0 0x7f8660171370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8660041f90 0x7f8660170e30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 msgr2=0x7f5cf014d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c4d0 tx=0x7f5ce000c990 comp rx=0 tx=0).stop 2023-06-23T18:49:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 --2- 172.21.15.38:0/454106123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8660041a20 0x7f86600c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 >> 172.21.15.38:0/454106123 conn(0x7f8660043920 msgr2=0x7f8660043cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 shutdown_connections 2023-06-23T18:49:58.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f5cdc0662b0 0x7f5cdc068760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf014e660 0x7f5cf00beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf014e290 0x7f5cf014d800 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c4d0 tx=0x7f5ce000c990 comp rx=0 tx=0).stop 2023-06-23T18:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 --2- 172.21.15.38:0/3573439818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cf00b5b50 0x7f5cf0148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 >> 172.21.15.38:0/3573439818 conn(0x7f5cf00bd730 msgr2=0x7f5cf006f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 shutdown_connections 2023-06-23T18:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f865cff9640 1 -- 172.21.15.38:0/454106123 wait complete. 2023-06-23T18:49:58.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 shutdown_connections 2023-06-23T18:49:58.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.281+0000 7f5cd5ffb640 1 -- 172.21.15.38:0/3573439818 wait complete. 2023-06-23T18:49:58.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2023-06-23T18:49:58.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89c004d790 con 0x7f89c006e050 2023-06-23T18:49:58.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89a7fff640 1 -- 172.21.15.38:0/4179030206 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89b001a090 con 0x7f89c006e050 2023-06-23T18:49:58.294 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.294 INFO:teuthology.orchestra.run.smithi038.stdout:64424509449 2023-06-23T18:49:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 msgr2=0x7f89ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 0x7f89ac068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89c00b7270 tx=0x7f89b4008040 comp rx=0 tx=0).stop 2023-06-23T18:49:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 msgr2=0x7f89c01f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89b000d860 tx=0x7f89b000dd20 comp rx=0 tx=0).stop 2023-06-23T18:49:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 shutdown_connections 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89ac066280 0x7f89ac068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c00bbb30 0x7f89c01f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89c00a4d30 0x7f89c006c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 --2- 172.21.15.38:0/4179030206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89c006e050 0x7f89c01f39a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 >> 172.21.15.38:0/4179030206 conn(0x7f89c00c0050 msgr2=0x7f89c0070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 shutdown_connections 2023-06-23T18:49:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.285+0000 7f89c5912640 1 -- 172.21.15.38:0/4179030206 wait complete. 2023-06-23T18:49:58.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.289+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa83416d600 con 0x7fa8340462a0 2023-06-23T18:49:58.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.289+0000 7fa838ff9640 1 -- 172.21.15.38:0/4181122304 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8280b3e60 con 0x7fa8340462a0 2023-06-23T18:49:58.297 INFO:teuthology.orchestra.run.smithi038.stdout:64424509450 2023-06-23T18:49:58.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 msgr2=0x7fa820068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 0x7fa820068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa830009f50 tx=0x7fa830009190 comp rx=0 tx=0).stop 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 msgr2=0x7fa8340c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa82801e730 tx=0x7fa82801f340 comp rx=0 tx=0).stop 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 shutdown_connections 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa820066280 0x7fa820068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa834046760 0x7fa8340ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8340462a0 0x7fa8340c9d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 --2- 172.21.15.38:0/4181122304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa834041640 0x7fa83403adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 >> 172.21.15.38:0/4181122304 conn(0x7fa834043810 msgr2=0x7fa83402b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 shutdown_connections 2023-06-23T18:49:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.293+0000 7fa84175a640 1 -- 172.21.15.38:0/4181122304 wait complete. 2023-06-23T18:49:58.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2023-06-23T18:49:58.305 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-06-23T18:49:58.308 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2023-06-23T18:49:58.315 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2023-06-23T18:49:58.316 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2023-06-23T18:49:58.320 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2023-06-23T18:49:58.326 DEBUG:teuthology.parallel:result is None 2023-06-23T18:49:58.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-23T18:49:58.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:49:58.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 Processor -- start 2023-06-23T18:49:58.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 -- start start 2023-06-23T18:49:58.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaa414b5a0 0x7ffaa40bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffaa40bb2a0 0x7ffaa414b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40bcad0 con 0x7ffaa40a2fa0 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa406f1f0 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaba70640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa4070d00 con 0x7ffaa414b5a0 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaa00d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffaa40bb2a0 0x7ffaa414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaa900b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffaa40a2fa0 0x7ffaa406e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39694/0 (socket says 172.21.15.38:39694) 2023-06-23T18:49:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaa900b640 1 -- 172.21.15.38:0/2022856643 learned_addr learned my addr 172.21.15.38:0/2022856643 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:58.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaa00d640 1 -- 172.21.15.38:0/2022856643 >> v2:172.21.15.81:3300/0 conn(0x7ffaa414b5a0 msgr2=0x7ffaa40bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:58.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaa980c640 1 --2- 172.21.15.38:0/2022856643 >> v2:172.21.15.81:3300/0 conn(0x7ffaa414b5a0 0x7ffaa40bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaa00d640 1 --2- 172.21.15.38:0/2022856643 >> v2:172.21.15.81:3300/0 conn(0x7ffaa414b5a0 0x7ffaa40bc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaa00d640 1 -- 172.21.15.38:0/2022856643 >> v1:172.21.15.38:6789/0 conn(0x7ffaa40a2fa0 legacy=0x7ffaa406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.469+0000 7ffaaa00d640 1 -- 172.21.15.38:0/2022856643 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40bcd70 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaa00d640 1 --2- 172.21.15.38:0/2022856643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa414b970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffaa406ae90 tx=0x7ffa9c01bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2f295fb1fa1e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa880a640 1 -- 172.21.15.38:0/2022856643 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a9640 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa880a640 1 -- 172.21.15.38:0/2022856643 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0a97a0 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa880a640 1 -- 172.21.15.38:0/2022856643 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a9b30 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- 172.21.15.38:0/2022856643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 msgr2=0x7ffaa414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- 172.21.15.38:0/2022856643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa414b970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffaa406ae90 tx=0x7ffa9c01bee0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- 172.21.15.38:0/2022856643 shutdown_connections 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- 172.21.15.38:0/2022856643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa414b970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- 172.21.15.38:0/2022856643 >> v2:172.21.15.81:3300/0 conn(0x7ffaa414b5a0 0x7ffaa40bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- 172.21.15.38:0/2022856643 >> 172.21.15.38:0/2022856643 conn(0x7ffaa40bd1b0 msgr2=0x7ffaa40bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- 172.21.15.38:0/2022856643 shutdown_connections 2023-06-23T18:49:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- 172.21.15.38:0/2022856643 wait complete. 2023-06-23T18:49:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 Processor -- start 2023-06-23T18:49:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- start start 2023-06-23T18:49:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa40a2fa0 0x7ffaa4149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa414b5a0 0x7ffaa40a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40a5110 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414a350 con 0x7ffaa40a2fa0 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaba70640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4143a50 con 0x7ffaa414b5a0 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51238/0 (socket says 172.21.15.38:51238) 2023-06-23T18:49:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 -- 172.21.15.38:0/427652161 learned_addr learned my addr 172.21.15.38:0/427652161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaaa00d640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa414b5a0 0x7ffaa40a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 -- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa414b5a0 msgr2=0x7ffaa40a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa414b5a0 0x7ffaa40a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 -- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa40a2fa0 msgr2=0x7ffaa4149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa40a2fa0 0x7ffaa4149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 -- 172.21.15.38:0/427652161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009420 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.473+0000 7ffaa900b640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c750 tx=0x7ffa9400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940072e0 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94007440 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa41e8d80 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940047f0 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa41e4d30 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa41e4f80 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa94004970 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 0x7ffa88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa94083700 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffaa980c640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 0x7ffa88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.477+0000 7ffaa980c640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 0x7ffa88068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007dc0 tx=0x7ffaa00072f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.481+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaa41e4f80 con 0x7ffaa40bb2a0 2023-06-23T18:49:58.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.625+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa41e4f80 con 0x7ffa88066280 2023-06-23T18:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.649+0000 7ffa9a7fc640 1 -- 172.21.15.38:0/427652161 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367437 (secure 0 0 0) 0x7ffaa41e4f80 con 0x7ffa88066280 2023-06-23T18:49:58.658 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:49:58.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 msgr2=0x7ffa88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 0x7ffa88068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007dc0 tx=0x7ffaa00072f0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 msgr2=0x7ffaa40a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c750 tx=0x7ffa9400cc10 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 shutdown_connections 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ffa88066280 0x7ffa88068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa414b5a0 0x7ffaa40a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffaa40bb2a0 0x7ffaa40a4690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 --2- 172.21.15.38:0/427652161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa40a2fa0 0x7ffaa4149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 >> 172.21.15.38:0/427652161 conn(0x7ffaa40bd1b0 msgr2=0x7ffaa414ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 shutdown_connections 2023-06-23T18:49:58.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.657+0000 7ffaaba70640 1 -- 172.21.15.38:0/427652161 wait complete. 2023-06-23T18:49:58.679 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-06-23T18:49:57.255272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230400,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744320,"statfs":{"total":773094113280,"available":772858183680,"internally_reserved":0,"allocated":2555904,"data_stored":2158974,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005346"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:46.336564+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:49:46.336564+0000","last_peered":"2023-06-23T18:49:46.336564+0000","last_clean":"2023-06-23T18:49:46.336564+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:49:46.336564+0000","last_undegraded":"2023-06-23T18:49:46.336564+0000","last_fullsized":"2023-06-23T18:49:46.336564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":125029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":124925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:49:58.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:49:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.833+0000 7f21412e3640 1 Processor -- start 2023-06-23T18:49:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.833+0000 7f21412e3640 1 -- start start 2023-06-23T18:49:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21412e3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f213c0be300 0x7f213c0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21412e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 0x7f213c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21412e3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c1505b0 con 0x7f213c06d470 2023-06-23T18:49:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21412e3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c14d120 con 0x7f213c0be300 2023-06-23T18:49:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21412e3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c0b86d0 con 0x7f213c14c7c0 2023-06-23T18:49:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f213c0be300 0x7f213c0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21327fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f213c06d470 0x7f213c14b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39698/0 (socket says 172.21.15.38:39698) 2023-06-23T18:49:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f21327fc640 1 -- 172.21.15.38:0/4038132779 learned_addr learned my addr 172.21.15.38:0/4038132779 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213b7fe640 1 --2- 172.21.15.38:0/4038132779 >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 0x7f213c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213affd640 1 -- 172.21.15.38:0/4038132779 >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 msgr2=0x7f213c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213affd640 1 --2- 172.21.15.38:0/4038132779 >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 0x7f213c14cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213a7fc640 1 -- 172.21.15.38:0/4038132779 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237954478 0 0) 0x7f213c1505b0 con 0x7f213c06d470 2023-06-23T18:49:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213affd640 1 -- 172.21.15.38:0/4038132779 >> v1:172.21.15.38:6789/0 conn(0x7f213c06d470 legacy=0x7f213c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213affd640 1 -- 172.21.15.38:0/4038132779 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c14c330 con 0x7f213c0be300 2023-06-23T18:49:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.837+0000 7f213b7fe640 1 --2- 172.21.15.38:0/4038132779 >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 0x7f213c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213affd640 1 --2- 172.21.15.38:0/4038132779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c0b6040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f213c0679a0 tx=0x7f212c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f1883e648aadf6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213a7fc640 1 -- 172.21.15.38:0/4038132779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0ab600 con 0x7f213c0be300 2023-06-23T18:49:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213a7fc640 1 -- 172.21.15.38:0/4038132779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c0a7050 con 0x7f213c0be300 2023-06-23T18:49:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213a7fc640 1 -- 172.21.15.38:0/4038132779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0ab980 con 0x7f213c0be300 2023-06-23T18:49:58.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- 172.21.15.38:0/4038132779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 msgr2=0x7f213c0b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- 172.21.15.38:0/4038132779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c0b6040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f213c0679a0 tx=0x7f212c01c460 comp rx=0 tx=0).stop 2023-06-23T18:49:58.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- 172.21.15.38:0/4038132779 shutdown_connections 2023-06-23T18:49:58.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- 172.21.15.38:0/4038132779 >> v2:172.21.15.81:3300/0 conn(0x7f213c14c7c0 0x7f213c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- 172.21.15.38:0/4038132779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c0b6040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- 172.21.15.38:0/4038132779 >> 172.21.15.38:0/4038132779 conn(0x7f213c0c1ba0 msgr2=0x7f213c0bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:58.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- 172.21.15.38:0/4038132779 shutdown_connections 2023-06-23T18:49:58.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- 172.21.15.38:0/4038132779 wait complete. 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 Processor -- start 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- start start 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213c06d470 0x7f213c0b9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f213c14c7c0 0x7f213c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c1e3f30 con 0x7f213c0be300 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0b9660 con 0x7f213c06d470 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21412e3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c14fc20 con 0x7f213c14c7c0 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51250/0 (socket says 172.21.15.38:51250) 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 -- 172.21.15.38:0/3216452331 learned_addr learned my addr 172.21.15.38:0/3216452331 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213b7fe640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f213c14c7c0 0x7f213c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f213affd640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213c06d470 0x7f213c0b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 -- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f213c14c7c0 msgr2=0x7f213c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f213c14c7c0 0x7f213c14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 -- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213c06d470 msgr2=0x7f213c0b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213c06d470 0x7f213c0b9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 -- 172.21.15.38:0/3216452331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009420 con 0x7f213c0be300 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.841+0000 7f21327fc640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21240011f0 tx=0x7f212400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240074e0 con 0x7f213c0be300 2023-06-23T18:49:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124007640 con 0x7f213c0be300 2023-06-23T18:49:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c0b98f0 con 0x7f213c0be300 2023-06-23T18:49:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124004a10 con 0x7f213c0be300 2023-06-23T18:49:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c1e41f0 con 0x7f213c0be300 2023-06-23T18:49:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c148e70 con 0x7f213c0be300 2023-06-23T18:49:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2124004b70 con 0x7f213c0be300 2023-06-23T18:49:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 0x7f211c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2124083150 con 0x7f213c0be300 2023-06-23T18:49:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f213affd640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 0x7f211c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.845+0000 7f213affd640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 0x7f211c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f212c0ad000 tx=0x7f212c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.849+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2124050370 con 0x7f213c0be300 2023-06-23T18:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:58.993+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f213c06eab0 con 0x7f211c0662b0 2023-06-23T18:49:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.017+0000 7f2133fff640 1 -- 172.21.15.38:0/3216452331 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367437 (secure 0 0 0) 0x7f212c0ab7a0 con 0x7f211c0662b0 2023-06-23T18:49:59.026 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:59.029 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:49:59.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 msgr2=0x7f211c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 0x7f211c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f212c0ad000 tx=0x7f212c008040 comp rx=0 tx=0).stop 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 msgr2=0x7f213c148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21240011f0 tx=0x7f212400c9b0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 shutdown_connections 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f211c0662b0 0x7f211c068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f213c14c7c0 0x7f213c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f213c0be300 0x7f213c148870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 --2- 172.21.15.38:0/3216452331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213c06d470 0x7f213c0b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 >> 172.21.15.38:0/3216452331 conn(0x7f213c0c1ba0 msgr2=0x7f213c0b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 shutdown_connections 2023-06-23T18:49:59.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.025+0000 7f21412e3640 1 -- 172.21.15.38:0/3216452331 wait complete. 2023-06-23T18:49:59.046 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-06-23T18:49:57.255272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230400,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744320,"statfs":{"total":773094113280,"available":772858183680,"internally_reserved":0,"allocated":2555904,"data_stored":2158974,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005346"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:46.336564+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:49:46.336564+0000","last_peered":"2023-06-23T18:49:46.336564+0000","last_clean":"2023-06-23T18:49:46.336564+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:49:46.336564+0000","last_undegraded":"2023-06-23T18:49:46.336564+0000","last_fullsized":"2023-06-23T18:49:46.336564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":125029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":124925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:49:59.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-23T18:49:59.055 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-23T18:49:59.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-23T18:49:59.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-23T18:49:59.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.201+0000 7fafd7abf640 1 Processor -- start 2023-06-23T18:49:59.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.201+0000 7fafd7abf640 1 -- start start 2023-06-23T18:49:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fafd00be300 0x7fafd006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd014e730 0x7fafd0069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd0152590 con 0x7fafd00702c0 2023-06-23T18:49:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd006f960 con 0x7fafd00be300 2023-06-23T18:49:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd006f580 con 0x7fafd014e730 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fafd00be300 0x7fafd006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fafd00be300 0x7fafd006fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51254/0 (socket says 172.21.15.38:51254) 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 -- 172.21.15.38:0/3999100353 learned_addr learned my addr 172.21.15.38:0/3999100353 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 -- 172.21.15.38:0/3999100353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd014e730 msgr2=0x7fafd0069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 --2- 172.21.15.38:0/3999100353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd014e730 0x7fafd0069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 -- 172.21.15.38:0/3999100353 >> v1:172.21.15.81:6789/0 conn(0x7fafd00702c0 legacy=0x7fafd0069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 -- 172.21.15.38:0/3999100353 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0152240 con 0x7fafd00be300 2023-06-23T18:49:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd585b640 1 --2- 172.21.15.38:0/3999100353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd00be300 0x7fafd006fd80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5468c5ce03ba58d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd4859640 1 -- 172.21.15.38:0/3999100353 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ab600 con 0x7fafd00be300 2023-06-23T18:49:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd4859640 1 -- 172.21.15.38:0/3999100353 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0a7050 con 0x7fafd00be300 2023-06-23T18:49:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd4859640 1 -- 172.21.15.38:0/3999100353 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ab980 con 0x7fafd00be300 2023-06-23T18:49:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- 172.21.15.38:0/3999100353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd00be300 msgr2=0x7fafd006fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 --2- 172.21.15.38:0/3999100353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd00be300 0x7fafd006fd80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc01c520 comp rx=0 tx=0).stop 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- 172.21.15.38:0/3999100353 shutdown_connections 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 --2- 172.21.15.38:0/3999100353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd014e730 0x7fafd0069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 --2- 172.21.15.38:0/3999100353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd00be300 0x7fafd006fd80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- 172.21.15.38:0/3999100353 >> 172.21.15.38:0/3999100353 conn(0x7fafd00c1ba0 msgr2=0x7fafd00bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- 172.21.15.38:0/3999100353 shutdown_connections 2023-06-23T18:49:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.205+0000 7fafd7abf640 1 -- 172.21.15.38:0/3999100353 wait complete. 2023-06-23T18:49:59.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 Processor -- start 2023-06-23T18:49:59.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- start start 2023-06-23T18:49:59.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 0x7fafd01ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 0x7fafd0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00bc8a0 con 0x7fafd014e730 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01e9b00 con 0x7fafd00702c0 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd01e9de0 con 0x7fafd00be300 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51270/0 (socket says 172.21.15.38:51270) 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 -- 172.21.15.38:0/1601089938 learned_addr learned my addr 172.21.15.38:0/1601089938 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd505a640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 0x7fafd0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd585b640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 0x7fafd01ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 -- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 msgr2=0x7fafd0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 0x7fafd0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 -- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 msgr2=0x7fafd01ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 0x7fafd01ea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 -- 172.21.15.38:0/1601089938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0094d0 con 0x7fafd014e730 2023-06-23T18:49:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd505a640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 0x7fafd0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd585b640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 0x7fafd01ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd605c640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafc800b9e0 tx=0x7fafc800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800cb20 con 0x7fafd014e730 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc800cc80 con 0x7fafd014e730 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd01ea0c0 con 0x7fafd014e730 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8014680 con 0x7fafd014e730 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd01514b0 con 0x7fafd014e730 2023-06-23T18:49:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd01ea300 con 0x7fafd014e730 2023-06-23T18:49:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fafc801d3b0 con 0x7fafd014e730 2023-06-23T18:49:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.209+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fafc8083ec0 con 0x7fafd014e730 2023-06-23T18:49:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.213+0000 7fafd585b640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.213+0000 7fafd585b640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 0x7fafb4068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0ad000 tx=0x7fafcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.213+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafd01ea300 con 0x7fafd014e730 2023-06-23T18:49:59.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fafd01ea300 con 0x7fafd014e730 2023-06-23T18:49:59.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafc67fc640 1 -- 172.21.15.38:0/1601089938 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fafc8019040 con 0x7fafd014e730 2023-06-23T18:49:59.402 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:59.403 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-23T18:49:59.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 msgr2=0x7fafb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 0x7fafb4068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0ad000 tx=0x7fafcc008040 comp rx=0 tx=0).stop 2023-06-23T18:49:59.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 msgr2=0x7fafd014a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafc800b9e0 tx=0x7fafc800bea0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 shutdown_connections 2023-06-23T18:49:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fafb4066280 0x7fafb4068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd014e730 0x7fafd014a520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafd00be300 0x7fafd0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 --2- 172.21.15.38:0/1601089938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd00702c0 0x7fafd01ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 >> 172.21.15.38:0/1601089938 conn(0x7fafd00c1ba0 msgr2=0x7fafd014c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 shutdown_connections 2023-06-23T18:49:59.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.397+0000 7fafd7abf640 1 -- 172.21.15.38:0/1601089938 wait complete. 2023-06-23T18:49:59.420 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-23T18:49:59.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:49:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 Processor -- start 2023-06-23T18:49:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 -- start start 2023-06-23T18:49:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25480b8dc0 0x7f25480b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 0x7f254814d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254806ec00 con 0x7f25480702a0 2023-06-23T18:49:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25480b8870 con 0x7f25480b8dc0 2023-06-23T18:49:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f254d86b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b8b10 con 0x7f254806e000 2023-06-23T18:49:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2546ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f25480702a0 0x7f25480b7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39708/0 (socket says 172.21.15.38:39708) 2023-06-23T18:49:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2546ffd640 1 -- 172.21.15.38:0/529540164 learned_addr learned my addr 172.21.15.38:0/529540164 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25477fe640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 0x7f254814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473406277 0 0) 0x7f254806ec00 con 0x7f25480702a0 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 --2- 172.21.15.38:0/529540164 >> v2:172.21.15.81:3300/0 conn(0x7f25480b8dc0 0x7f25480b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2534003530 con 0x7f25480702a0 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914459309 0 0) 0x7f2534003530 con 0x7f25480702a0 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 msgr2=0x7f254814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 0x7f254814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 >> v2:172.21.15.81:3300/0 conn(0x7f25480b8dc0 msgr2=0x7f25480b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 --2- 172.21.15.38:0/529540164 >> v2:172.21.15.81:3300/0 conn(0x7f25480b8dc0 0x7f25480b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254806e890 con 0x7f25480702a0 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f2538001680 con 0x7f25480702a0 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 >> v1:172.21.15.38:6789/0 conn(0x7f25480702a0 legacy=0x7f25480b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534003980 0x7f2534003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25340043b0 0x7f2534004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 0x7f2534004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b8870 con 0x7f25340043b0 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b8b10 con 0x7f2534003980 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253400b990 con 0x7f254806e000 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25340043b0 0x7f2534004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f2546ffd640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534003980 0x7f2534003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 -- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 msgr2=0x7f2534004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f254806e000 0x7f2534004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 -- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534003980 msgr2=0x7f2534003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2534003980 0x7f2534003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.533+0000 7f25467fc640 1 -- 172.21.15.38:0/529540164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534003530 con 0x7f25340043b0 2023-06-23T18:49:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f25467fc640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25340043b0 0x7f2534004870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2530009b10 tx=0x7f253001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0becc5819bcd8c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300a5570 con 0x7f25340043b0 2023-06-23T18:49:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25300a56d0 con 0x7f25340043b0 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f2545ffb640 1 -- 172.21.15.38:0/529540164 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300a5a80 con 0x7f25340043b0 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- 172.21.15.38:0/529540164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25340043b0 msgr2=0x7f2534004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 --2- 172.21.15.38:0/529540164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25340043b0 0x7f2534004870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2530009b10 tx=0x7f253001ca90 comp rx=0 tx=0).stop 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f25477fe640 1 -- 172.21.15.38:0/529540164 reap_dead start 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- 172.21.15.38:0/529540164 shutdown_connections 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- 172.21.15.38:0/529540164 >> 172.21.15.38:0/529540164 conn(0x7f25480c20e0 msgr2=0x7f25480c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- 172.21.15.38:0/529540164 shutdown_connections 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- 172.21.15.38:0/529540164 wait complete. 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 Processor -- start 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.537+0000 7f254d86b640 1 -- start start 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340043b0 0x7f2548142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2548142c40 0x7f25481e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481e5fe0 con 0x7f25481e9ab0 2023-06-23T18:49:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480c1c30 con 0x7f25340043b0 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25481e9f30 con 0x7f2548142c40 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51278/0 (socket says 172.21.15.38:51278) 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 -- 172.21.15.38:0/3652437617 learned_addr learned my addr 172.21.15.38:0/3652437617 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f2546ffd640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340043b0 0x7f2548142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25477fe640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2548142c40 0x7f25481e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 -- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2548142c40 msgr2=0x7f25481e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2548142c40 0x7f25481e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 -- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340043b0 msgr2=0x7f2548142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340043b0 0x7f2548142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 -- 172.21.15.38:0/3652437617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25481e5c70 con 0x7f25481e9ab0 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f25467fc640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2530009b10 tx=0x7f2534005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253000f000 con 0x7f25481e9ab0 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530004020 con 0x7f25481e9ab0 2023-06-23T18:49:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25481430e0 con 0x7f25481e9ab0 2023-06-23T18:49:59.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300043d0 con 0x7f25481e9ab0 2023-06-23T18:49:59.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25481e69b0 con 0x7f25481e9ab0 2023-06-23T18:49:59.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25481e6190 con 0x7f25481e9ab0 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25300b4040 con 0x7f25481e9ab0 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 0x7f2528068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f253011ded0 con 0x7f25481e9ab0 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.541+0000 7f2546ffd640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 0x7f2528068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.545+0000 7f2546ffd640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 0x7f2528068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2538001ec0 tx=0x7f2538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.545+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25481e6190 con 0x7f25481e9ab0 2023-06-23T18:49:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.693+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25481e6190 con 0x7f25481e9ab0 2023-06-23T18:49:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f253ffff640 1 -- 172.21.15.38:0/3652437617 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f25481e6190 con 0x7f25481e9ab0 2023-06-23T18:49:59.703 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:49:59.703 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:49:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 msgr2=0x7f2528068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 0x7f2528068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2538001ec0 tx=0x7f2538009040 comp rx=0 tx=0).stop 2023-06-23T18:49:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 msgr2=0x7f25480c16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2530009b10 tx=0x7f2534005800 comp rx=0 tx=0).stop 2023-06-23T18:49:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 shutdown_connections 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25280662b0 0x7f2528068760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2548142c40 0x7f25481e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25481e9ab0 0x7f25480c16f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 --2- 172.21.15.38:0/3652437617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340043b0 0x7f2548142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 >> 172.21.15.38:0/3652437617 conn(0x7f25480c20e0 msgr2=0x7f254806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 shutdown_connections 2023-06-23T18:49:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.697+0000 7f254d86b640 1 -- 172.21.15.38:0/3652437617 wait complete. 2023-06-23T18:49:59.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:49:59.722 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:49:59.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.833+0000 7fee490f4640 1 Processor -- start 2023-06-23T18:49:59.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.833+0000 7fee490f4640 1 -- start start 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee490f4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee440c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee490f4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee44149980 0x7fee4414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee490f4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee44070270 con 0x7fee440ba7f0 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee490f4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee441504e0 con 0x7fee44149980 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee490f4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4414ff20 con 0x7fee4406c4b0 2023-06-23T18:49:59.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee440ba7f0 0x7fee44149270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39710/0 (socket says 172.21.15.38:39710) 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4259c640 1 -- 172.21.15.38:0/1157832048 learned_addr learned my addr 172.21.15.38:0/1157832048 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee42d9d640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee440c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 --2- 172.21.15.38:0/1157832048 >> v2:172.21.15.81:3300/0 conn(0x7fee44149980 0x7fee4414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097716916 0 0) 0x7fee44070270 con 0x7fee440ba7f0 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee2c003530 con 0x7fee440ba7f0 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091475092 0 0) 0x7fee2c003530 con 0x7fee440ba7f0 2023-06-23T18:49:59.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 msgr2=0x7fee440c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee440c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 >> v2:172.21.15.81:3300/0 conn(0x7fee44149980 msgr2=0x7fee4414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 --2- 172.21.15.38:0/1157832048 >> v2:172.21.15.81:3300/0 conn(0x7fee44149980 0x7fee4414bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44150200 con 0x7fee440ba7f0 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fee38001680 con 0x7fee440ba7f0 2023-06-23T18:49:59.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 >> v1:172.21.15.38:6789/0 conn(0x7fee440ba7f0 legacy=0x7fee44149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee2c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c003f00 0x7fee2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee441504e0 con 0x7fee2c004d10 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4414ff20 con 0x7fee2c003f00 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c00b9c0 con 0x7fee4406c4b0 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee42d9d640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee2c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4259c640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c003f00 0x7fee2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 -- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 msgr2=0x7fee2c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee4406c4b0 0x7fee2c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 -- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c003f00 msgr2=0x7fee2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c003f00 0x7fee2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4359e640 1 -- 172.21.15.38:0/1157832048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c003530 con 0x7fee2c004d10 2023-06-23T18:49:59.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.837+0000 7fee4259c640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c003f00 0x7fee2c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:49:59.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4359e640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee2c005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009f90 tx=0x7fee3c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef44fc59771685f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0a5c70 con 0x7fee2c004d10 2023-06-23T18:49:59.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00f040 con 0x7fee2c004d10 2023-06-23T18:49:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee41d9b640 1 -- 172.21.15.38:0/1157832048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0ad440 con 0x7fee2c004d10 2023-06-23T18:49:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- 172.21.15.38:0/1157832048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 msgr2=0x7fee2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 --2- 172.21.15.38:0/1157832048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee2c005180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009f90 tx=0x7fee3c01cc00 comp rx=0 tx=0).stop 2023-06-23T18:49:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4359e640 1 -- 172.21.15.38:0/1157832048 reap_dead start 2023-06-23T18:49:59.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- 172.21.15.38:0/1157832048 shutdown_connections 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- 172.21.15.38:0/1157832048 >> 172.21.15.38:0/1157832048 conn(0x7fee440bfe30 msgr2=0x7fee440c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- 172.21.15.38:0/1157832048 shutdown_connections 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- 172.21.15.38:0/1157832048 wait complete. 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 Processor -- start 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- start start 2023-06-23T18:49:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 0x7fee44148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 0x7fee441e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee44148850 con 0x7fee2c004d10 2023-06-23T18:49:59.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440a5940 con 0x7fee44147ea0 2023-06-23T18:49:59.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee490f4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee441e54d0 con 0x7fee441e0e80 2023-06-23T18:49:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51308/0 (socket says 172.21.15.38:51308) 2023-06-23T18:49:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 -- 172.21.15.38:0/880380707 learned_addr learned my addr 172.21.15.38:0/880380707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:49:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4359e640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 0x7fee441e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 -- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 msgr2=0x7fee441e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 0x7fee441e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 -- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 msgr2=0x7fee44148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4259c640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 0x7fee44148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 0x7fee44148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 -- 172.21.15.38:0/880380707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440a54b0 con 0x7fee2c004d10 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4359e640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 0x7fee441e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee4259c640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 0x7fee44148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.841+0000 7fee42d9d640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee34011610 tx=0x7fee34011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34015870 con 0x7fee2c004d10 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee340159d0 con 0x7fee2c004d10 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee441e4f50 con 0x7fee2c004d10 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34015d40 con 0x7fee2c004d10 2023-06-23T18:49:59.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee441e1840 con 0x7fee2c004d10 2023-06-23T18:49:59.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4404d790 con 0x7fee2c004d10 2023-06-23T18:49:59.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee340263f0 con 0x7fee2c004d10 2023-06-23T18:49:59.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 0x7fee30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:59.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee340847c0 con 0x7fee2c004d10 2023-06-23T18:49:59.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee4259c640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 0x7fee30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:59.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.845+0000 7fee4259c640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 0x7fee30068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee38004880 tx=0x7fee380047f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:59.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:49:59.849+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee34055470 con 0x7fee2c004d10 2023-06-23T18:50:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.001+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee440a5280 con 0x7fee2c004d10 2023-06-23T18:50:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee2b7fe640 1 -- 172.21.15.38:0/880380707 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee34055000 con 0x7fee2c004d10 2023-06-23T18:50:00.010 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 msgr2=0x7fee30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 0x7fee30068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee38004880 tx=0x7fee380047f0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 msgr2=0x7fee4409b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee34011610 tx=0x7fee34011ad0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 shutdown_connections 2023-06-23T18:50:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fee300662b0 0x7fee30068760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee441e0e80 0x7fee441e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee44147ea0 0x7fee44148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 --2- 172.21.15.38:0/880380707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee2c004d10 0x7fee4409b4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 >> 172.21.15.38:0/880380707 conn(0x7fee440bfe30 msgr2=0x7fee440be4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 shutdown_connections 2023-06-23T18:50:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.005+0000 7fee490f4640 1 -- 172.21.15.38:0/880380707 wait complete. 2023-06-23T18:50:00.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 Processor -- start 2023-06-23T18:50:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 -- start start 2023-06-23T18:50:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc22414b570 0x7fc22414b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2240a6570 0x7fc22406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc224069e80 con 0x7fc22406bfc0 2023-06-23T18:50:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22406c3c0 con 0x7fc22414b570 2023-06-23T18:50:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22bdf1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22414be80 con 0x7fc2240a6570 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc22414b570 0x7fc22414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc22414b570 0x7fc22414b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51316/0 (socket says 172.21.15.38:51316) 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 -- 172.21.15.38:0/910850805 learned_addr learned my addr 172.21.15.38:0/910850805 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc22938c640 1 --2- 172.21.15.38:0/910850805 >> v2:172.21.15.81:3300/0 conn(0x7fc2240a6570 0x7fc22406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 -- 172.21.15.38:0/910850805 >> v2:172.21.15.81:3300/0 conn(0x7fc2240a6570 msgr2=0x7fc22406ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 --2- 172.21.15.38:0/910850805 >> v2:172.21.15.81:3300/0 conn(0x7fc2240a6570 0x7fc22406ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 -- 172.21.15.38:0/910850805 >> v1:172.21.15.81:6789/0 conn(0x7fc22406bfc0 legacy=0x7fc2240a37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.141+0000 7fc229b8d640 1 -- 172.21.15.38:0/910850805 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240a5d90 con 0x7fc22414b570 2023-06-23T18:50:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc229b8d640 1 --2- 172.21.15.38:0/910850805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22414b570 0x7fc22414b940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2240713d0 tx=0x7fc21401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9fb14631e2d08b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc228b8b640 1 -- 172.21.15.38:0/910850805 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140ab600 con 0x7fc22414b570 2023-06-23T18:50:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc228b8b640 1 -- 172.21.15.38:0/910850805 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2140a7050 con 0x7fc22414b570 2023-06-23T18:50:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc228b8b640 1 -- 172.21.15.38:0/910850805 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140ab980 con 0x7fc22414b570 2023-06-23T18:50:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- 172.21.15.38:0/910850805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22414b570 msgr2=0x7fc22414b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/910850805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22414b570 0x7fc22414b940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2240713d0 tx=0x7fc21401c3a0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- 172.21.15.38:0/910850805 shutdown_connections 2023-06-23T18:50:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/910850805 >> v2:172.21.15.81:3300/0 conn(0x7fc2240a6570 0x7fc22406ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/910850805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22414b570 0x7fc22414b940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- 172.21.15.38:0/910850805 >> 172.21.15.38:0/910850805 conn(0x7fc2240bd180 msgr2=0x7fc2240bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- 172.21.15.38:0/910850805 shutdown_connections 2023-06-23T18:50:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- 172.21.15.38:0/910850805 wait complete. 2023-06-23T18:50:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 Processor -- start 2023-06-23T18:50:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.145+0000 7fc22bdf1640 1 -- start start 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2240a6570 0x7fc22414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc22414b570 0x7fc224147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241e7320 con 0x7fc22406bfc0 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241e7570 con 0x7fc2240a6570 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241e7850 con 0x7fc22414b570 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51322/0 (socket says 172.21.15.38:51322) 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 -- 172.21.15.38:0/3113847972 learned_addr learned my addr 172.21.15.38:0/3113847972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22a38e640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc22414b570 0x7fc224147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22938c640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2240a6570 0x7fc22414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 -- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc22414b570 msgr2=0x7fc224147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc22414b570 0x7fc224147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 -- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2240a6570 msgr2=0x7fc22414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2240a6570 0x7fc22414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 -- 172.21.15.38:0/3113847972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140094d0 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc229b8d640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2140ae040 tx=0x7fc21401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140b6420 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2140b6580 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140b6930 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22414f170 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2240a1eb0 con 0x7fc22406bfc0 2023-06-23T18:50:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22404d790 con 0x7fc22406bfc0 2023-06-23T18:50:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2140b2040 con 0x7fc22406bfc0 2023-06-23T18:50:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 0x7fc208068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc21411e290 con 0x7fc22406bfc0 2023-06-23T18:50:00.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.149+0000 7fc22938c640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 0x7fc208068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.153+0000 7fc22938c640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 0x7fc208068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2240b71d0 tx=0x7fc220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.153+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2140eb540 con 0x7fc22406bfc0 2023-06-23T18:50:00.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.305+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2240bd550 con 0x7fc22406bfc0 2023-06-23T18:50:00.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.305+0000 7fc21a7fc640 1 -- 172.21.15.38:0/3113847972 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2140eeb60 con 0x7fc22406bfc0 2023-06-23T18:50:00.313 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:00.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 msgr2=0x7fc208068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 0x7fc208068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2240b71d0 tx=0x7fc220008040 comp rx=0 tx=0).stop 2023-06-23T18:50:00.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 msgr2=0x7fc2241e7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2140ae040 tx=0x7fc21401abe0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 shutdown_connections 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc208066280 0x7fc208068730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc22414b570 0x7fc224147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2240a6570 0x7fc22414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 --2- 172.21.15.38:0/3113847972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc22406bfc0 0x7fc2241e7d70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 >> 172.21.15.38:0/3113847972 conn(0x7fc2240bd180 msgr2=0x7fc22414f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 shutdown_connections 2023-06-23T18:50:00.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.309+0000 7fc22bdf1640 1 -- 172.21.15.38:0/3113847972 wait complete. 2023-06-23T18:50:00.331 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.441+0000 7f4b3ec04640 1 Processor -- start 2023-06-23T18:50:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.441+0000 7f4b3ec04640 1 -- start start 2023-06-23T18:50:00.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3ec04640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b380a3850 0x7f4b380bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3ec04640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 0x7f4b38151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3ec04640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b380c23a0 con 0x7f4b380be890 2023-06-23T18:50:00.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3ec04640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b380c1490 con 0x7f4b380a3850 2023-06-23T18:50:00.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3ec04640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380aa080 con 0x7f4b380bf1a0 2023-06-23T18:50:00.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3c9a0640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4b380be890 0x7f4b380c0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39724/0 (socket says 172.21.15.38:39724) 2023-06-23T18:50:00.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3c9a0640 1 -- 172.21.15.38:0/2000756142 learned_addr learned my addr 172.21.15.38:0/2000756142 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:00.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b37fff640 1 --2- 172.21.15.38:0/2000756142 >> v2:172.21.15.81:3300/0 conn(0x7f4b380a3850 0x7f4b380bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 --2- 172.21.15.38:0/2000756142 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 0x7f4b38151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980961033 0 0) 0x7f4b380c23a0 con 0x7f4b380be890 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b24003530 con 0x7f4b380be890 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 -- 172.21.15.38:0/2000756142 >> v2:172.21.15.81:3300/0 conn(0x7f4b380a3850 msgr2=0x7f4b380bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 --2- 172.21.15.38:0/2000756142 >> v2:172.21.15.81:3300/0 conn(0x7f4b380a3850 0x7f4b380bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 -- 172.21.15.38:0/2000756142 >> v1:172.21.15.38:6789/0 conn(0x7f4b380be890 legacy=0x7f4b380c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060470774 0 0) 0x7f4b24003530 con 0x7f4b380be890 2023-06-23T18:50:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 -- 172.21.15.38:0/2000756142 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b380bb060 con 0x7f4b380bf1a0 2023-06-23T18:50:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.445+0000 7f4b3d1a1640 1 --2- 172.21.15.38:0/2000756142 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 0x7f4b38151a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009d90 tx=0x7f4b3001c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6a7d6e12f82f52 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28001680 con 0x7f4b380bf1a0 2023-06-23T18:50:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b300a6490 con 0x7f4b380bf1a0 2023-06-23T18:50:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b377fe640 1 -- 172.21.15.38:0/2000756142 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b300a6800 con 0x7f4b380bf1a0 2023-06-23T18:50:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/2000756142 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 msgr2=0x7f4b38151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/2000756142 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 0x7f4b38151a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009d90 tx=0x7f4b3001c750 comp rx=0 tx=0).stop 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/2000756142 shutdown_connections 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/2000756142 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380bf1a0 0x7f4b38151a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/2000756142 >> v2:172.21.15.81:3300/0 conn(0x7f4b380a3850 0x7f4b380bec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/2000756142 >> 172.21.15.38:0/2000756142 conn(0x7f4b380a5d50 msgr2=0x7f4b380a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/2000756142 shutdown_connections 2023-06-23T18:50:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/2000756142 wait complete. 2023-06-23T18:50:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 Processor -- start 2023-06-23T18:50:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- start start 2023-06-23T18:50:00.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380be890 0x7f4b380be130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b38152a70 0x7f4b380bd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b38153a00 con 0x7f4b380a3850 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b38153020 con 0x7f4b38152a70 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380bcb90 con 0x7f4b380be890 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51336/0 (socket says 172.21.15.38:51336) 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 -- 172.21.15.38:0/1093399365 learned_addr learned my addr 172.21.15.38:0/1093399365 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:00.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3d1a1640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b38152a70 0x7f4b380bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 -- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380be890 msgr2=0x7f4b380be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380be890 0x7f4b380be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 -- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b38152a70 msgr2=0x7f4b380bd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b38152a70 0x7f4b380bd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 -- 172.21.15.38:0/1093399365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30009a70 con 0x7f4b380a3850 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3c9a0640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c750 tx=0x7f4b2800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28005ae0 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28005c40 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b380be670 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28007070 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b38158be0 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.449+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3804d790 con 0x7f4b380a3850 2023-06-23T18:50:00.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.453+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b280071d0 con 0x7f4b380a3850 2023-06-23T18:50:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.453+0000 7f4b357fa640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 0x7f4b18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.453+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b28083e80 con 0x7f4b380a3850 2023-06-23T18:50:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.453+0000 7f4b37fff640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 0x7f4b18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.453+0000 7f4b37fff640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 0x7f4b18068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006aa0 tx=0x7f4b20006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.457+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b28051020 con 0x7f4b380a3850 2023-06-23T18:50:00.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b380a9890 con 0x7f4b380a3850 2023-06-23T18:50:00.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b357fa640 1 -- 172.21.15.38:0/1093399365 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b28054640 con 0x7f4b380a3850 2023-06-23T18:50:00.615 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 msgr2=0x7f4b18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 0x7f4b18068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006aa0 tx=0x7f4b20006a30 comp rx=0 tx=0).stop 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 msgr2=0x7f4b380bcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c750 tx=0x7f4b2800cc10 comp rx=0 tx=0).stop 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 shutdown_connections 2023-06-23T18:50:00.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4b18066280 0x7f4b18068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b38152a70 0x7f4b380bd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b380be890 0x7f4b380be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 --2- 172.21.15.38:0/1093399365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b380a3850 0x7f4b380bcde0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 >> 172.21.15.38:0/1093399365 conn(0x7f4b380a5d50 msgr2=0x7f4b38151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 shutdown_connections 2023-06-23T18:50:00.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.609+0000 7f4b3ec04640 1 -- 172.21.15.38:0/1093399365 wait complete. 2023-06-23T18:50:00.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 Processor -- start 2023-06-23T18:50:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 -- start start 2023-06-23T18:50:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fefdc14bc80 0x7fefdc131960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fefdc131ea0 0x7fefdc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc14fd20 con 0x7fefdc0701c0 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc150000 con 0x7fefdc131ea0 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe2cea640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc060b60 con 0x7fefdc14bc80 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fefdc131ea0 0x7fefdc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fefdc131ea0 0x7fefdc0b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51344/0 (socket says 172.21.15.38:51344) 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 -- 172.21.15.38:0/3736603144 learned_addr learned my addr 172.21.15.38:0/3736603144 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefd3fff640 1 --2- 172.21.15.38:0/3736603144 >> v2:172.21.15.81:3300/0 conn(0x7fefdc14bc80 0x7fefdc131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 -- 172.21.15.38:0/3736603144 >> v2:172.21.15.81:3300/0 conn(0x7fefdc14bc80 msgr2=0x7fefdc131960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:00.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 --2- 172.21.15.38:0/3736603144 >> v2:172.21.15.81:3300/0 conn(0x7fefdc14bc80 0x7fefdc131960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 -- 172.21.15.38:0/3736603144 >> v1:172.21.15.81:6789/0 conn(0x7fefdc0701c0 legacy=0x7fefdc070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.745+0000 7fefe1287640 1 -- 172.21.15.38:0/3736603144 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc06e5d0 con 0x7fefdc131ea0 2023-06-23T18:50:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe1287640 1 --2- 172.21.15.38:0/3736603144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc0b7260 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefdc06f1c0 tx=0x7fefd401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb26c31f6f45266 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefdbfff640 1 -- 172.21.15.38:0/3736603144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a5600 con 0x7fefdc131ea0 2023-06-23T18:50:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefdbfff640 1 -- 172.21.15.38:0/3736603144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40a5760 con 0x7fefdc131ea0 2023-06-23T18:50:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefdbfff640 1 -- 172.21.15.38:0/3736603144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40a5af0 con 0x7fefdc131ea0 2023-06-23T18:50:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- 172.21.15.38:0/3736603144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 msgr2=0x7fefdc0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- 172.21.15.38:0/3736603144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc0b7260 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefdc06f1c0 tx=0x7fefd401c940 comp rx=0 tx=0).stop 2023-06-23T18:50:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- 172.21.15.38:0/3736603144 shutdown_connections 2023-06-23T18:50:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- 172.21.15.38:0/3736603144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc0b7260 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- 172.21.15.38:0/3736603144 >> v2:172.21.15.81:3300/0 conn(0x7fefdc14bc80 0x7fefdc131960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- 172.21.15.38:0/3736603144 >> 172.21.15.38:0/3736603144 conn(0x7fefdc0c1fa0 msgr2=0x7fefdc0c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- 172.21.15.38:0/3736603144 shutdown_connections 2023-06-23T18:50:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- 172.21.15.38:0/3736603144 wait complete. 2023-06-23T18:50:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 Processor -- start 2023-06-23T18:50:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- start start 2023-06-23T18:50:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 0x7fefdc06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc14bc80 0x7fefdc1e9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc06c460 con 0x7fefdc131ea0 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc12fde0 con 0x7fefdc14bc80 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe2cea640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1563f0 con 0x7fefdc0701c0 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51356/0 (socket says 172.21.15.38:51356) 2023-06-23T18:50:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefd3fff640 1 -- 172.21.15.38:0/4254252983 learned_addr learned my addr 172.21.15.38:0/4254252983 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.749+0000 7fefe0a86640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 0x7fefdc06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe1287640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc14bc80 0x7fefdc1e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 -- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 msgr2=0x7fefdc06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 0x7fefdc06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 -- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc14bc80 msgr2=0x7fefdc1e9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc14bc80 0x7fefdc1e9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 -- 172.21.15.38:0/4254252983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009b30 con 0x7fefdc131ea0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe0a86640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 0x7fefdc06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd3fff640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fefc400e8a0 tx=0x7fefc400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4009510 con 0x7fefdc131ea0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc400c940 con 0x7fefdc131ea0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc06ba30 con 0x7fefdc131ea0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400ccb0 con 0x7fefdc131ea0 2023-06-23T18:50:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc133550 con 0x7fefdc131ea0 2023-06-23T18:50:00.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc04dfe0 con 0x7fefdc131ea0 2023-06-23T18:50:00.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefc4013470 con 0x7fefdc131ea0 2023-06-23T18:50:00.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 0x7fefbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:00.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fefc4084030 con 0x7fefdc131ea0 2023-06-23T18:50:00.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe0a86640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 0x7fefbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:00.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.753+0000 7fefe0a86640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 0x7fefbc068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000f70 tx=0x7fefcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:00.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.757+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefc4051250 con 0x7fefdc131ea0 2023-06-23T18:50:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.909+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefdc0c1280 con 0x7fefdc131ea0 2023-06-23T18:50:00.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.909+0000 7fefd9ffb640 1 -- 172.21.15.38:0/4254252983 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefc4054870 con 0x7fefdc131ea0 2023-06-23T18:50:00.915 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:00.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 msgr2=0x7fefbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 0x7fefbc068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000f70 tx=0x7fefcc009040 comp rx=0 tx=0).stop 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 msgr2=0x7fefdc155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fefc400e8a0 tx=0x7fefc400eca0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 shutdown_connections 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fefbc066280 0x7fefbc068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc14bc80 0x7fefdc1e9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefdc131ea0 0x7fefdc155eb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 --2- 172.21.15.38:0/4254252983 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fefdc0701c0 0x7fefdc06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:00.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 >> 172.21.15.38:0/4254252983 conn(0x7fefdc0c1fa0 msgr2=0x7fefdc0c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:00.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 shutdown_connections 2023-06-23T18:50:00.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:00.913+0000 7fefe2cea640 1 -- 172.21.15.38:0/4254252983 wait complete. 2023-06-23T18:50:00.933 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 Processor -- start 2023-06-23T18:50:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 -- start start 2023-06-23T18:50:01.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f509c0be890 0x7f509c0c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f509c0a3270 0x7f509c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0c23a0 con 0x7f509c0a3850 2023-06-23T18:50:01.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0bf370 con 0x7f509c0a3270 2023-06-23T18:50:01.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f50a136b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0aa080 con 0x7f509c0be890 2023-06-23T18:50:01.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f509c0a3270 0x7f509c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f509c0a3270 0x7f509c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51358/0 (socket says 172.21.15.38:51358) 2023-06-23T18:50:01.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 -- 172.21.15.38:0/3652613846 learned_addr learned my addr 172.21.15.38:0/3652613846 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:01.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509affd640 1 --2- 172.21.15.38:0/3652613846 >> v2:172.21.15.81:3300/0 conn(0x7f509c0be890 0x7f509c0c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 -- 172.21.15.38:0/3652613846 >> v2:172.21.15.81:3300/0 conn(0x7f509c0be890 msgr2=0x7f509c0c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 --2- 172.21.15.38:0/3652613846 >> v2:172.21.15.81:3300/0 conn(0x7f509c0be890 0x7f509c0c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 -- 172.21.15.38:0/3652613846 >> v1:172.21.15.81:6789/0 conn(0x7f509c0a3850 legacy=0x7f509c0bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 -- 172.21.15.38:0/3652613846 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0bb060 con 0x7f509c0a3270 2023-06-23T18:50:01.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509b7fe640 1 --2- 172.21.15.38:0/3652613846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c151a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5094009e50 tx=0x7f509401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da4c040c002f0fa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509a7fc640 1 -- 172.21.15.38:0/3652613846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940a8450 con 0x7f509c0a3270 2023-06-23T18:50:01.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509a7fc640 1 -- 172.21.15.38:0/3652613846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50940a85b0 con 0x7f509c0a3270 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.045+0000 7f509a7fc640 1 -- 172.21.15.38:0/3652613846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940a8940 con 0x7f509c0a3270 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/3652613846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 msgr2=0x7f509c151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- 172.21.15.38:0/3652613846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c151a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5094009e50 tx=0x7f509401c5f0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/3652613846 shutdown_connections 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- 172.21.15.38:0/3652613846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c151a60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- 172.21.15.38:0/3652613846 >> v2:172.21.15.81:3300/0 conn(0x7f509c0be890 0x7f509c0c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/3652613846 >> 172.21.15.38:0/3652613846 conn(0x7f509c0a5d50 msgr2=0x7f509c0a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/3652613846 shutdown_connections 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/3652613846 wait complete. 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 Processor -- start 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- start start 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f509c0a3850 0x7f509c14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c0be890 0x7f509c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0bdbd0 con 0x7f509c0a3270 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c150870 con 0x7f509c0be890 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c150c90 con 0x7f509c0a3850 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51370/0 (socket says 172.21.15.38:51370) 2023-06-23T18:50:01.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 -- 172.21.15.38:0/4162785802 learned_addr learned my addr 172.21.15.38:0/4162785802 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 -- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f509c0a3850 msgr2=0x7f509c14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f509c0a3850 0x7f509c14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 -- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c0be890 msgr2=0x7f509c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509b7fe640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c0be890 0x7f509c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c0be890 0x7f509c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 -- 172.21.15.38:0/4162785802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009b30 con 0x7f509c0a3270 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f509affd640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d800 tx=0x7f508c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00b6c0 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c00b860 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00bc10 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c14e710 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.049+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c0a7520 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c150ae0 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f508c01e460 con 0x7f509c0a3270 2023-06-23T18:50:01.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f5093fff640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 0x7f507c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f508c084550 con 0x7f509c0a3270 2023-06-23T18:50:01.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f50927fc640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 0x7f507c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.053+0000 7f50927fc640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 0x7f507c068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5084000f70 tx=0x7f50840079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.057+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f508c051770 con 0x7f509c0a3270 2023-06-23T18:50:01.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.201+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f509c04d790 con 0x7f509c0a3270 2023-06-23T18:50:01.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.201+0000 7f5093fff640 1 -- 172.21.15.38:0/4162785802 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f508c054d90 con 0x7f509c0a3270 2023-06-23T18:50:01.280 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:01.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 msgr2=0x7f507c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 0x7f507c068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5084000f70 tx=0x7f50840079c0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 msgr2=0x7f509c0ba780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d800 tx=0x7f508c00dcc0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 shutdown_connections 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f507c0662b0 0x7f507c068760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c0be890 0x7f509c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f509c0a3850 0x7f509c14e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 --2- 172.21.15.38:0/4162785802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f509c0a3270 0x7f509c0ba780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 >> 172.21.15.38:0/4162785802 conn(0x7f509c0a5d50 msgr2=0x7f509c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 shutdown_connections 2023-06-23T18:50:01.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.205+0000 7f50a136b640 1 -- 172.21.15.38:0/4162785802 wait complete. 2023-06-23T18:50:01.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:50:01.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.397+0000 7f7bfb104640 1 Processor -- start 2023-06-23T18:50:01.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 -- start start 2023-06-23T18:50:01.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bf406c6d0 0x7f7bf4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40b9ca0 con 0x7f7bf40bc4f0 2023-06-23T18:50:01.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40714a0 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bfb104640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf406a3f0 con 0x7f7bf406c6d0 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51384/0 (socket says 172.21.15.38:51384) 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 -- 172.21.15.38:0/789732848 learned_addr learned my addr 172.21.15.38:0/789732848 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf8ea0640 1 --2- 172.21.15.38:0/789732848 >> v2:172.21.15.81:3300/0 conn(0x7f7bf406c6d0 0x7f7bf4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 -- 172.21.15.38:0/789732848 >> v2:172.21.15.81:3300/0 conn(0x7f7bf406c6d0 msgr2=0x7f7bf4070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/789732848 >> v2:172.21.15.81:3300/0 conn(0x7f7bf406c6d0 0x7f7bf4070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 -- 172.21.15.38:0/789732848 >> v1:172.21.15.81:6789/0 conn(0x7f7bf40bc4f0 legacy=0x7f7bf414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 -- 172.21.15.38:0/789732848 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40ba390 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/789732848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7bf406a6e0 tx=0x7f7be801eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9df32a171a9010 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf37fe640 1 -- 172.21.15.38:0/789732848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80a79e0 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf37fe640 1 -- 172.21.15.38:0/789732848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80a7b40 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.401+0000 7f7bf37fe640 1 -- 172.21.15.38:0/789732848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80af440 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/789732848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf40bd9b0 msgr2=0x7f7bf40a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- 172.21.15.38:0/789732848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7bf406a6e0 tx=0x7f7be801eb00 comp rx=0 tx=0).stop 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/789732848 shutdown_connections 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- 172.21.15.38:0/789732848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf40bd9b0 0x7f7bf40a4ea0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- 172.21.15.38:0/789732848 >> v2:172.21.15.81:3300/0 conn(0x7f7bf406c6d0 0x7f7bf4070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/789732848 >> 172.21.15.38:0/789732848 conn(0x7f7bf40c0c90 msgr2=0x7f7bf40bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/789732848 shutdown_connections 2023-06-23T18:50:01.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/789732848 wait complete. 2023-06-23T18:50:01.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 Processor -- start 2023-06-23T18:50:01.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- start start 2023-06-23T18:50:01.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 0x7f7bf41e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7bf40bd9b0 0x7f7bf41e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf414d8c0 con 0x7f7bf406c6d0 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41402b0 con 0x7f7bf40bc4f0 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4148df0 con 0x7f7bf40bd9b0 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51398/0 (socket says 172.21.15.38:51398) 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 -- 172.21.15.38:0/1561137663 learned_addr learned my addr 172.21.15.38:0/1561137663 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 0x7f7bf41e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf96a1640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7bf40bd9b0 0x7f7bf41e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 -- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7bf40bd9b0 msgr2=0x7f7bf41e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7bf40bd9b0 0x7f7bf41e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 -- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 msgr2=0x7f7bf41e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 0x7f7bf41e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 -- 172.21.15.38:0/1561137663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be800b770 con 0x7f7bf406c6d0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 0x7f7bf41e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf8ea0640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c7f0 tx=0x7f7be400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4007820 con 0x7f7bf406c6d0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4007980 con 0x7f7bf406c6d0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf414f4d0 con 0x7f7bf406c6d0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4007d30 con 0x7f7bf406c6d0 2023-06-23T18:50:01.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.405+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4140660 con 0x7f7bf406c6d0 2023-06-23T18:50:01.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404d790 con 0x7f7bf406c6d0 2023-06-23T18:50:01.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7be40113f0 con 0x7f7bf406c6d0 2023-06-23T18:50:01.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bf17fa640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 0x7f7be0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7be4084310 con 0x7f7bf406c6d0 2023-06-23T18:50:01.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 0x7f7be0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.409+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 0x7f7be0068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7be80b1000 tx=0x7f7be80a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.413+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7be4051490 con 0x7f7bf406c6d0 2023-06-23T18:50:01.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.597+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf406f990 con 0x7f7bf406c6d0 2023-06-23T18:50:01.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bf17fa640 1 -- 172.21.15.38:0/1561137663 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7f7be401fc70 con 0x7f7bf406c6d0 2023-06-23T18:50:01.606 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:01.606 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:50:01.607 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:50:01.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 msgr2=0x7f7be0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 0x7f7be0068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7be80b1000 tx=0x7f7be80a9070 comp rx=0 tx=0).stop 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 msgr2=0x7f7bf414ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c7f0 tx=0x7f7be400ccb0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 shutdown_connections 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7be0066280 0x7f7be0068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7bf40bd9b0 0x7f7bf41e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf40bc4f0 0x7f7bf41e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 --2- 172.21.15.38:0/1561137663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bf406c6d0 0x7f7bf414ef90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 >> 172.21.15.38:0/1561137663 conn(0x7f7bf40c0c90 msgr2=0x7f7bf406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 shutdown_connections 2023-06-23T18:50:01.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.601+0000 7f7bfb104640 1 -- 172.21.15.38:0/1561137663 wait complete. 2023-06-23T18:50:01.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:01.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.741+0000 7f0440961640 1 Processor -- start 2023-06-23T18:50:01.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.741+0000 7f0440961640 1 -- start start 2023-06-23T18:50:01.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0440961640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f043c06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0440961640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0ba9d0 con 0x7f043c0bd1e0 2023-06-23T18:50:01.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0440961640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c071080 con 0x7f043c06c9b0 2023-06-23T18:50:01.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0440961640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0bc300 con 0x7f043c14b930 2023-06-23T18:50:01.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0439d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f043c0bd1e0 0x7f043c070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39726/0 (socket says 172.21.15.38:39726) 2023-06-23T18:50:01.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0439d9b640 1 -- 172.21.15.38:0/2771368415 learned_addr learned my addr 172.21.15.38:0/2771368415 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:01.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043a59c640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f043c06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392268462 0 0) 0x7f043c0ba9d0 con 0x7f043c0bd1e0 2023-06-23T18:50:01.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0428003530 con 0x7f043c0bd1e0 2023-06-23T18:50:01.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225580786 0 0) 0x7f0428003530 con 0x7f043c0bd1e0 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 msgr2=0x7f043c06c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f043c06c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 >> v1:172.21.15.81:6789/0 conn(0x7f043c06c9b0 legacy=0x7f043c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c150160 con 0x7f043c0bd1e0 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f0424001680 con 0x7f043c0bd1e0 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 >> v1:172.21.15.38:6789/0 conn(0x7f043c0bd1e0 legacy=0x7f043c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04280039b0 0x7f0428003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f04280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0428004d10 0x7f0428005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0bc300 con 0x7f0428004d10 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042800ba40 con 0x7f04280039b0 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042800bbd0 con 0x7f043c14b930 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0428004d10 0x7f0428005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f0439d9b640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f04280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043a59c640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04280039b0 0x7f0428003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 -- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 msgr2=0x7f04280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f043c14b930 0x7f04280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 -- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04280039b0 msgr2=0x7f0428003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04280039b0 0x7f0428003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.745+0000 7f043ad9d640 1 -- 172.21.15.38:0/2771368415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428003530 con 0x7f0428004d10 2023-06-23T18:50:01.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043ad9d640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0428004d10 0x7f0428005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0434001e70 tx=0x7f043401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2c7965a6fd17b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434003b80 con 0x7f0428004d10 2023-06-23T18:50:01.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434003ce0 con 0x7f0428004d10 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043959a640 1 -- 172.21.15.38:0/2771368415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340052c0 con 0x7f0428004d10 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/2771368415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0428004d10 msgr2=0x7f0428005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 --2- 172.21.15.38:0/2771368415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0428004d10 0x7f0428005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0434001e70 tx=0x7f043401c760 comp rx=0 tx=0).stop 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043ad9d640 1 -- 172.21.15.38:0/2771368415 reap_dead start 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/2771368415 shutdown_connections 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/2771368415 >> 172.21.15.38:0/2771368415 conn(0x7f043c0c0c90 msgr2=0x7f043c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/2771368415 shutdown_connections 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/2771368415 wait complete. 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 Processor -- start 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- start start 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0428004d10 0x7f043c14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f043c099350 0x7f043c0a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a5570 con 0x7f043c0b8ae0 2023-06-23T18:50:01.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c14b140 con 0x7f043c099350 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c098ae0 con 0x7f0428004d10 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51414/0 (socket says 172.21.15.38:51414) 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 -- 172.21.15.38:0/3872200199 learned_addr learned my addr 172.21.15.38:0/3872200199 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043a59c640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0428004d10 0x7f043c14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f043ad9d640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f043c099350 0x7f043c0a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 -- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0428004d10 msgr2=0x7f043c14ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0428004d10 0x7f043c14ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 -- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f043c099350 msgr2=0x7f043c0a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f043c099350 0x7f043c0a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 -- 172.21.15.38:0/3872200199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c098dc0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0439d9b640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f042400e7e0 tx=0x7f042400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400c8d0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042400ca50 con 0x7f043c0b8ae0 2023-06-23T18:50:01.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400ce00 con 0x7f043c0b8ae0 2023-06-23T18:50:01.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0990a0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.749+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c1e21e0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c1e42e0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f042401d460 con 0x7f043c0b8ae0 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f0432ffd640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 0x7f041c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0424084080 con 0x7f043c0b8ae0 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f043a59c640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 0x7f041c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:01.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.753+0000 7f043a59c640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 0x7f041c068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f042c009a30 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.757+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04240b4700 con 0x7f043c0b8ae0 2023-06-23T18:50:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.909+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f043c04d790 con 0x7f043c0b8ae0 2023-06-23T18:50:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0432ffd640 1 -- 172.21.15.38:0/3872200199 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f043c1e42e0 con 0x7f043c0b8ae0 2023-06-23T18:50:01.919 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:01.919 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:01.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 msgr2=0x7f041c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 0x7f041c068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f042c009a30 tx=0x7f042c008040 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 msgr2=0x7f043c0a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f042400e7e0 tx=0x7f042400eca0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 shutdown_connections 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f041c066280 0x7f041c068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f043c099350 0x7f043c0a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f043c0b8ae0 0x7f043c0a4200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 --2- 172.21.15.38:0/3872200199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0428004d10 0x7f043c14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 >> 172.21.15.38:0/3872200199 conn(0x7f043c0c0c90 msgr2=0x7f043c1489b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:01.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 shutdown_connections 2023-06-23T18:50:01.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:01.913+0000 7f0440961640 1 -- 172.21.15.38:0/3872200199 wait complete. 2023-06-23T18:50:01.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:01.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:02.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.061+0000 7fc2594b5640 1 Processor -- start 2023-06-23T18:50:02.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.061+0000 7fc2594b5640 1 -- start start 2023-06-23T18:50:02.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2594b5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2540712c0 0x7fc25414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2594b5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc25414c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2594b5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25414fd20 con 0x7fc254131d80 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2594b5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540b8270 con 0x7fc2540712c0 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2594b5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc254132150 con 0x7fc254134f90 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc252ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc254131d80 0x7fc254070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39742/0 (socket says 172.21.15.38:39742) 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc252ffd640 1 -- 172.21.15.38:0/2528416827 learned_addr learned my addr 172.21.15.38:0/2528416827 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc25414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2527fc640 1 --2- 172.21.15.38:0/2528416827 >> v2:172.21.15.81:3300/0 conn(0x7fc2540712c0 0x7fc25414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640183170 0 0) 0x7fc25414fd20 con 0x7fc254131d80 2023-06-23T18:50:02.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc240003530 con 0x7fc254131d80 2023-06-23T18:50:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601639411 0 0) 0x7fc240003530 con 0x7fc254131d80 2023-06-23T18:50:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 msgr2=0x7fc25414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc25414c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 >> v2:172.21.15.81:3300/0 conn(0x7fc2540712c0 msgr2=0x7fc25414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 --2- 172.21.15.38:0/2528416827 >> v2:172.21.15.81:3300/0 conn(0x7fc2540712c0 0x7fc25414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254150250 con 0x7fc254131d80 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fc244001a00 con 0x7fc254131d80 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 >> v1:172.21.15.38:6789/0 conn(0x7fc254131d80 legacy=0x7fc254070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc240003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240003f00 0x7fc2400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc240004d10 0x7fc240005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254132150 con 0x7fc240004d10 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24000b9f0 con 0x7fc240003f00 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24000bbb0 con 0x7fc254134f90 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc240004d10 0x7fc240005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2527fc640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240003f00 0x7fc2400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 -- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 msgr2=0x7fc240003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc252ffd640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc240003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc240003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 -- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240003f00 msgr2=0x7fc2400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240003f00 0x7fc2400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2537fe640 1 -- 172.21.15.38:0/2528416827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240003530 con 0x7fc240004d10 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc2527fc640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240003f00 0x7fc2400047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.065+0000 7fc252ffd640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc254134f90 0x7fc240003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2537fe640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc240004d10 0x7fc240005180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009ab0 tx=0x7fc24c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7de12c909d1b704 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0a5510 con 0x7fc240004d10 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c0a5670 con 0x7fc240004d10 2023-06-23T18:50:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc251ffb640 1 -- 172.21.15.38:0/2528416827 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0a5a20 con 0x7fc240004d10 2023-06-23T18:50:02.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/2528416827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc240004d10 msgr2=0x7fc240005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 --2- 172.21.15.38:0/2528416827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc240004d10 0x7fc240005180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009ab0 tx=0x7fc24c01ca00 comp rx=0 tx=0).stop 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2537fe640 1 -- 172.21.15.38:0/2528416827 reap_dead start 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/2528416827 shutdown_connections 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/2528416827 >> 172.21.15.38:0/2528416827 conn(0x7fc2540c1fd0 msgr2=0x7fc2540c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/2528416827 shutdown_connections 2023-06-23T18:50:02.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/2528416827 wait complete. 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 Processor -- start 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- start start 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 0x7fc25414e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 0x7fc2541306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2541454a0 con 0x7fc254144550 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254143a50 con 0x7fc254145e00 2023-06-23T18:50:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc254143770 con 0x7fc2541e40d0 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51436/0 (socket says 172.21.15.38:51436) 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 -- 172.21.15.38:0/255536460 learned_addr learned my addr 172.21.15.38:0/255536460 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2537fe640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 0x7fc2541306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 -- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 msgr2=0x7fc2541306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 0x7fc2541306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc252ffd640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 0x7fc25414e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 -- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 msgr2=0x7fc25414e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 0x7fc25414e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 -- 172.21.15.38:0/255536460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25414d320 con 0x7fc254144550 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2537fe640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 0x7fc2541306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc252ffd640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 0x7fc25414e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2527fc640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc23c010920 tx=0x7fc23c010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ec20 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c00ed80 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254144aa0 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c004220 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.069+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc254144230 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25414d4b0 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc23c004380 con 0x7fc254144550 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc24b7fe640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 0x7fc234068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc23c083f90 con 0x7fc254144550 2023-06-23T18:50:02.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc252ffd640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 0x7fc234068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.073+0000 7fc252ffd640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 0x7fc234068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc244001b30 tx=0x7fc244009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.077+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc23c0b4700 con 0x7fc254144550 2023-06-23T18:50:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.237+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc25404d790 con 0x7fc254144550 2023-06-23T18:50:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.237+0000 7fc24b7fe640 1 -- 172.21.15.38:0/255536460 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc23c0511b0 con 0x7fc254144550 2023-06-23T18:50:02.244 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:02.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 msgr2=0x7fc234068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 0x7fc234068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc244001b30 tx=0x7fc244009040 comp rx=0 tx=0).stop 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 msgr2=0x7fc2541e3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc23c010920 tx=0x7fc23c010de0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 shutdown_connections 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc234066280 0x7fc234068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc2541e40d0 0x7fc2541306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc254144550 0x7fc2541e3b90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 --2- 172.21.15.38:0/255536460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc254145e00 0x7fc25414e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 >> 172.21.15.38:0/255536460 conn(0x7fc2540c1fd0 msgr2=0x7fc25414af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 shutdown_connections 2023-06-23T18:50:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.241+0000 7fc2594b5640 1 -- 172.21.15.38:0/255536460 wait complete. 2023-06-23T18:50:02.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 Processor -- start 2023-06-23T18:50:02.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 -- start start 2023-06-23T18:50:02.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 0x7f5034158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340c23a0 con 0x7f50340be890 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340bf370 con 0x7f50340a3850 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f503b81f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c1490 con 0x7f50340a3270 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f50395bb640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f50340be890 0x7f50340c0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39756/0 (socket says 172.21.15.38:39756) 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f50395bb640 1 -- 172.21.15.38:0/2011650242 learned_addr learned my addr 172.21.15.38:0/2011650242 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 0x7f5034158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379405376 0 0) 0x7f50340c23a0 con 0x7f50340be890 2023-06-23T18:50:02.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5020003530 con 0x7f50340be890 2023-06-23T18:50:02.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892461825 0 0) 0x7f5020003530 con 0x7f50340be890 2023-06-23T18:50:02.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 msgr2=0x7f5034158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 0x7f5034158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 >> v1:172.21.15.81:6789/0 conn(0x7f50340a3850 legacy=0x7f50340bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340aa080 con 0x7f50340be890 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f5030001680 con 0x7f50340be890 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 >> v1:172.21.15.38:6789/0 conn(0x7f50340be890 legacy=0x7f50340c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 0x7f5020003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 0x7f50200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5020004d10 0x7f5020005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502000bb50 con 0x7f5020004d10 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502000bcc0 con 0x7f50200039b0 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502000be80 con 0x7f50340a3270 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5020004d10 0x7f5020005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f50395bb640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 0x7f5020003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 -- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 msgr2=0x7f50200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50340a3270 0x7f50200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 -- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 msgr2=0x7f5020003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 0x7f5020003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.381+0000 7f5039dbc640 1 -- 172.21.15.38:0/2011650242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020003530 con 0x7f5020004d10 2023-06-23T18:50:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f5039dbc640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5020004d10 0x7f5020005180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f502c009f90 tx=0x7f502c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffbdc6ba09b6ade server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0a5b60 con 0x7f5020004d10 2023-06-23T18:50:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00f040 con 0x7f5020004d10 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f502bfff640 1 -- 172.21.15.38:0/2011650242 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0ad440 con 0x7f5020004d10 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- 172.21.15.38:0/2011650242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5020004d10 msgr2=0x7f5020005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 --2- 172.21.15.38:0/2011650242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5020004d10 0x7f5020005180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f502c009f90 tx=0x7f502c01cc60 comp rx=0 tx=0).stop 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f5039dbc640 1 -- 172.21.15.38:0/2011650242 reap_dead start 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- 172.21.15.38:0/2011650242 shutdown_connections 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- 172.21.15.38:0/2011650242 >> 172.21.15.38:0/2011650242 conn(0x7f50340a5d50 msgr2=0x7f50340a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- 172.21.15.38:0/2011650242 shutdown_connections 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- 172.21.15.38:0/2011650242 wait complete. 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 Processor -- start 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- start start 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5020004d10 0x7f5034155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5034155c90 0x7f50341e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503414fc90 con 0x7f50341e6650 2023-06-23T18:50:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341e5c50 con 0x7f5020004d10 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f503b81f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503414fea0 con 0x7f5034155c90 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.385+0000 7f5039dbc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51456/0 (socket says 172.21.15.38:51456) 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 -- 172.21.15.38:0/1490511151 learned_addr learned my addr 172.21.15.38:0/1490511151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f50395bb640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5020004d10 0x7f5034155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5038dba640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5034155c90 0x7f50341e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 -- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5034155c90 msgr2=0x7f50341e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5034155c90 0x7f50341e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 -- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5020004d10 msgr2=0x7f5034155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5020004d10 0x7f5034155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 -- 172.21.15.38:0/1490511151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034150180 con 0x7f50341e6650 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5039dbc640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f502c009f90 tx=0x7f502c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0039a0 con 0x7f50341e6650 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c003b00 con 0x7f50341e6650 2023-06-23T18:50:02.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c004030 con 0x7f50341e6650 2023-06-23T18:50:02.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5034149370 con 0x7f50341e6650 2023-06-23T18:50:02.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50341e6ac0 con 0x7f50341e6650 2023-06-23T18:50:02.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034150310 con 0x7f50341e6650 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f502c0b4040 con 0x7f50341e6650 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 0x7f5018068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f502c11d520 con 0x7f50341e6650 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f50395bb640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 0x7f5018068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.389+0000 7f50395bb640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 0x7f5018068760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5030001ec0 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.393+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f502c0ea700 con 0x7f50341e6650 2023-06-23T18:50:02.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.545+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f503404d790 con 0x7f50341e6650 2023-06-23T18:50:02.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.545+0000 7f5029ffb640 1 -- 172.21.15.38:0/1490511151 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f502c0edd20 con 0x7f50341e6650 2023-06-23T18:50:02.552 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 msgr2=0x7f5018068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 0x7f5018068760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5030001ec0 tx=0x7f5030009040 comp rx=0 tx=0).stop 2023-06-23T18:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 msgr2=0x7f50341e91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f502c009f90 tx=0x7f502c009750 comp rx=0 tx=0).stop 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 shutdown_connections 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f50180662b0 0x7f5018068760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50341e6650 0x7f50341e91c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5034155c90 0x7f50341e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 --2- 172.21.15.38:0/1490511151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5020004d10 0x7f5034155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 >> 172.21.15.38:0/1490511151 conn(0x7f50340a5d50 msgr2=0x7f50340a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 shutdown_connections 2023-06-23T18:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.549+0000 7f503b81f640 1 -- 172.21.15.38:0/1490511151 wait complete. 2023-06-23T18:50:02.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:02.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 Processor -- start 2023-06-23T18:50:02.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 -- start start 2023-06-23T18:50:02.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed140ba7f0 0x7fed140c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed14070270 con 0x7fed14149980 2023-06-23T18:50:02.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1414ff20 con 0x7fed1406c4b0 2023-06-23T18:50:02.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed18b02640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed141504e0 con 0x7fed140ba7f0 2023-06-23T18:50:02.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fed14149980 0x7fed14070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39768/0 (socket says 172.21.15.38:39768) 2023-06-23T18:50:02.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 -- 172.21.15.38:0/2140010166 learned_addr learned my addr 172.21.15.38:0/2140010166 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed12d9d640 1 --2- 172.21.15.38:0/2140010166 >> v2:172.21.15.81:3300/0 conn(0x7fed140ba7f0 0x7fed140c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265604522 0 0) 0x7fed14070270 con 0x7fed14149980 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecfc003530 con 0x7fed14149980 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334733897 0 0) 0x7fecfc003530 con 0x7fed14149980 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 >> v2:172.21.15.81:3300/0 conn(0x7fed140ba7f0 msgr2=0x7fed140c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 --2- 172.21.15.38:0/2140010166 >> v2:172.21.15.81:3300/0 conn(0x7fed140ba7f0 0x7fed140c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 >> v1:172.21.15.81:6789/0 conn(0x7fed1406c4b0 legacy=0x7fed14149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14150200 con 0x7fed14149980 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fed04001680 con 0x7fed14149980 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 >> v1:172.21.15.38:6789/0 conn(0x7fed14149980 legacy=0x7fed14070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc003980 0x7fecfc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 0x7fecfc004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecfc005030 0x7fecfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed141504e0 con 0x7fecfc004370 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc00bf80 con 0x7fecfc005030 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc00c140 con 0x7fecfc003980 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 0x7fecfc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 -- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc003980 msgr2=0x7fecfc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc003980 0x7fecfc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 -- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecfc005030 msgr2=0x7fecfc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed12d9d640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecfc005030 0x7fecfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecfc005030 0x7fecfc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed11d9b640 1 -- 172.21.15.38:0/2140010166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc003530 con 0x7fecfc004370 2023-06-23T18:50:02.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.689+0000 7fed12d9d640 1 -- 172.21.15.38:0/2140010166 reap_dead start 2023-06-23T18:50:02.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 0x7fecfc004830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c160 tx=0x7fed0401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521cdfcb02deec81 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04005ae0 con 0x7fecfc004370 2023-06-23T18:50:02.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04005c60 con 0x7fecfc004370 2023-06-23T18:50:02.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed1159a640 1 -- 172.21.15.38:0/2140010166 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040a5a60 con 0x7fecfc004370 2023-06-23T18:50:02.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 msgr2=0x7fecfc004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 0x7fecfc004830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c160 tx=0x7fed0401cb60 comp rx=0 tx=0).stop 2023-06-23T18:50:02.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- 172.21.15.38:0/2140010166 shutdown_connections 2023-06-23T18:50:02.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 --2- 172.21.15.38:0/2140010166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc004370 0x7fecfc004830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- 172.21.15.38:0/2140010166 >> 172.21.15.38:0/2140010166 conn(0x7fed140bfe30 msgr2=0x7fed140c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- 172.21.15.38:0/2140010166 shutdown_connections 2023-06-23T18:50:02.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- 172.21.15.38:0/2140010166 wait complete. 2023-06-23T18:50:02.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 Processor -- start 2023-06-23T18:50:02.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- start start 2023-06-23T18:50:02.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc004370 0x7fed140a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed1413d010 0x7fed1413d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1413ecb0 con 0x7fed1414a570 2023-06-23T18:50:02.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1414ce70 con 0x7fed1413d010 2023-06-23T18:50:02.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed18b02640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1414cbd0 con 0x7fecfc004370 2023-06-23T18:50:02.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51462/0 (socket says 172.21.15.38:51462) 2023-06-23T18:50:02.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 -- 172.21.15.38:0/3683012499 learned_addr learned my addr 172.21.15.38:0/3683012499 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:02.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed1259c640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc004370 0x7fed140a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed12d9d640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed1413d010 0x7fed1413d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 -- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc004370 msgr2=0x7fed140a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc004370 0x7fed140a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 -- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed1413d010 msgr2=0x7fed1413d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed1413d010 0x7fed1413d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 -- 172.21.15.38:0/3683012499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1414c7e0 con 0x7fed1414a570 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed11d9b640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed0401c990 tx=0x7fecfc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040b4070 con 0x7fed1414a570 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.693+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed040a5af0 con 0x7fed1414a570 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1413de90 con 0x7fed1414a570 2023-06-23T18:50:02.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040a5e60 con 0x7fed1414a570 2023-06-23T18:50:02.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed140a5800 con 0x7fed1414a570 2023-06-23T18:50:02.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1404d790 con 0x7fed1414a570 2023-06-23T18:50:02.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed04007110 con 0x7fed1414a570 2023-06-23T18:50:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed02ffd640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 0x7fecf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed0411dc20 con 0x7fed1414a570 2023-06-23T18:50:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed1259c640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 0x7fecf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.697+0000 7fed1259c640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 0x7fecf4068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed1413f280 tx=0x7fed0800a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.701+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed040eaf20 con 0x7fed1414a570 2023-06-23T18:50:02.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed140bc6d0 con 0x7fed1414a570 2023-06-23T18:50:02.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed02ffd640 1 -- 172.21.15.38:0/3683012499 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed040ee540 con 0x7fed1414a570 2023-06-23T18:50:02.856 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:02.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 msgr2=0x7fecf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 0x7fecf4068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed1413f280 tx=0x7fed0800a420 comp rx=0 tx=0).stop 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 msgr2=0x7fed1414c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed0401c990 tx=0x7fecfc005800 comp rx=0 tx=0).stop 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 shutdown_connections 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fecf40662b0 0x7fecf4068760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed1413d010 0x7fed1413d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed1414a570 0x7fed1414c2a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.849+0000 7fed18b02640 1 --2- 172.21.15.38:0/3683012499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fecfc004370 0x7fed140a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.853+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 >> 172.21.15.38:0/3683012499 conn(0x7fed140bfe30 msgr2=0x7fed14149040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.853+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 shutdown_connections 2023-06-23T18:50:02.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.853+0000 7fed18b02640 1 -- 172.21.15.38:0/3683012499 wait complete. 2023-06-23T18:50:02.873 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:02.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.981+0000 7f187cb26640 1 Processor -- start 2023-06-23T18:50:02.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.981+0000 7f187cb26640 1 -- start start 2023-06-23T18:50:02.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 0x7f18780c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1878149980 0x7f187814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1878070270 con 0x7f18780ba7f0 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18781504e0 con 0x7f1878149980 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187814ff20 con 0x7f187806c4b0 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1878149980 0x7f187814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1878149980 0x7f187814bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51474/0 (socket says 172.21.15.38:51474) 2023-06-23T18:50:02.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 -- 172.21.15.38:0/3410823835 learned_addr learned my addr 172.21.15.38:0/3410823835 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187659c640 1 --2- 172.21.15.38:0/3410823835 >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 0x7f18780c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 -- 172.21.15.38:0/3410823835 >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 msgr2=0x7f18780c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 --2- 172.21.15.38:0/3410823835 >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 0x7f18780c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 -- 172.21.15.38:0/3410823835 >> v1:172.21.15.81:6789/0 conn(0x7f18780ba7f0 legacy=0x7f1878149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 -- 172.21.15.38:0/3410823835 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878150200 con 0x7f1878149980 2023-06-23T18:50:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187659c640 1 --2- 172.21.15.38:0/3410823835 >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 0x7f18780c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:02.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f1876d9d640 1 --2- 172.21.15.38:0/3410823835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187814bfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f187806dc30 tx=0x7f187001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7d93d4a8f5dc32 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:02.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187559a640 1 -- 172.21.15.38:0/3410823835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a55c0 con 0x7f1878149980 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187559a640 1 -- 172.21.15.38:0/3410823835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700a5720 con 0x7f1878149980 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187559a640 1 -- 172.21.15.38:0/3410823835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a5ab0 con 0x7f1878149980 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- 172.21.15.38:0/3410823835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 msgr2=0x7f187814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 --2- 172.21.15.38:0/3410823835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187814bfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f187806dc30 tx=0x7f187001c900 comp rx=0 tx=0).stop 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- 172.21.15.38:0/3410823835 shutdown_connections 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 --2- 172.21.15.38:0/3410823835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187814bfa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 --2- 172.21.15.38:0/3410823835 >> v2:172.21.15.81:3300/0 conn(0x7f187806c4b0 0x7f18780c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- 172.21.15.38:0/3410823835 >> 172.21.15.38:0/3410823835 conn(0x7f18780bfe30 msgr2=0x7f18780c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:02.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- 172.21.15.38:0/3410823835 shutdown_connections 2023-06-23T18:50:02.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.985+0000 7f187cb26640 1 -- 172.21.15.38:0/3410823835 wait complete. 2023-06-23T18:50:02.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 Processor -- start 2023-06-23T18:50:02.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- start start 2023-06-23T18:50:02.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 0x7f187813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18780ba7f0 0x7f1878140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187813fad0 con 0x7f1878149980 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187814e570 con 0x7f18780ba7f0 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187814f720 con 0x7f187806c4b0 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51482/0 (socket says 172.21.15.38:51482) 2023-06-23T18:50:02.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 -- 172.21.15.38:0/3711732186 learned_addr learned my addr 172.21.15.38:0/3711732186 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187659c640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 0x7f187813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 -- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 msgr2=0x7f187813ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1875d9b640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18780ba7f0 0x7f1878140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 0x7f187813ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 -- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18780ba7f0 msgr2=0x7f1878140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18780ba7f0 0x7f1878140340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 -- 172.21.15.38:0/3711732186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009b30 con 0x7f1878149980 2023-06-23T18:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187659c640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 0x7f187813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1876d9d640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f187001a530 tx=0x7f18700196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a55c0 con 0x7f1878149980 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700b88c0 con 0x7f1878149980 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187814f220 con 0x7f1878149980 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700b8c70 con 0x7f1878149980 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18781e7cf0 con 0x7f1878149980 2023-06-23T18:50:03.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18781e7870 con 0x7f1878149980 2023-06-23T18:50:03.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18700cb480 con 0x7f1878149980 2023-06-23T18:50:03.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 0x7f1858068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.989+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1870120030 con 0x7f1878149980 2023-06-23T18:50:03.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.993+0000 7f187659c640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 0x7f1858068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.993+0000 7f187659c640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 0x7f1858068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f186c008930 tx=0x7f186c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:02.993+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18700ed330 con 0x7f1878149980 2023-06-23T18:50:03.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f187814f440 con 0x7f1878149980 2023-06-23T18:50:03.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f1866ffd640 1 -- 172.21.15.38:0/3711732186 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f187814f440 con 0x7f1878149980 2023-06-23T18:50:03.147 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 msgr2=0x7f1858068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 0x7f1858068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f186c008930 tx=0x7f186c008040 comp rx=0 tx=0).stop 2023-06-23T18:50:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 msgr2=0x7f187813dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f187001a530 tx=0x7f18700196a0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 shutdown_connections 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1858066280 0x7f1858068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1878149980 0x7f187813dbf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18780ba7f0 0x7f1878140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 --2- 172.21.15.38:0/3711732186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f187806c4b0 0x7f187813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 >> 172.21.15.38:0/3711732186 conn(0x7f18780bfe30 msgr2=0x7f1878149240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 shutdown_connections 2023-06-23T18:50:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.141+0000 7f187cb26640 1 -- 172.21.15.38:0/3711732186 wait complete. 2023-06-23T18:50:03.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.285+0000 7fe25203f640 1 Processor -- start 2023-06-23T18:50:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.285+0000 7fe25203f640 1 -- start start 2023-06-23T18:50:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe25203f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe25203f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 0x7fe24c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe25203f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c070270 con 0x7fe24c06c4b0 2023-06-23T18:50:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe25203f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c1504e0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe25203f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c14ff20 con 0x7fe24c149980 2023-06-23T18:50:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 0x7fe24c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:49854/0 (socket says 172.21.15.38:49854) 2023-06-23T18:50:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe24c06c4b0 0x7fe24c149270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:55170/0 (socket says 172.21.15.38:55170) 2023-06-23T18:50:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 -- 172.21.15.38:0/1813602424 learned_addr learned my addr 172.21.15.38:0/1813602424 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24a7fc640 1 -- 172.21.15.38:0/1813602424 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074148076 0 0) 0x7fe24c070270 con 0x7fe24c06c4b0 2023-06-23T18:50:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24a7fc640 1 -- 172.21.15.38:0/1813602424 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe234003530 con 0x7fe24c06c4b0 2023-06-23T18:50:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 -- 172.21.15.38:0/1813602424 >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 msgr2=0x7fe24c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 --2- 172.21.15.38:0/1813602424 >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 0x7fe24c14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 -- 172.21.15.38:0/1813602424 >> v1:172.21.15.81:6789/0 conn(0x7fe24c06c4b0 legacy=0x7fe24c149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24affd640 1 -- 172.21.15.38:0/1813602424 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c150200 con 0x7fe24c149980 2023-06-23T18:50:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.289+0000 7fe24bfff640 1 --2- 172.21.15.38:0/1813602424 >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 0x7fe24c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:50:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24affd640 1 --2- 172.21.15.38:0/1813602424 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe240009870 tx=0x7fe24001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba88171b8f52c2a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24a7fc640 1 -- 172.21.15.38:0/1813602424 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400ab600 con 0x7fe24c149980 2023-06-23T18:50:03.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24a7fc640 1 -- 172.21.15.38:0/1813602424 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2400a7050 con 0x7fe24c149980 2023-06-23T18:50:03.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24a7fc640 1 -- 172.21.15.38:0/1813602424 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400ab980 con 0x7fe24c149980 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- 172.21.15.38:0/1813602424 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 msgr2=0x7fe24c0c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- 172.21.15.38:0/1813602424 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe240009870 tx=0x7fe24001c540 comp rx=0 tx=0).stop 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- 172.21.15.38:0/1813602424 shutdown_connections 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- 172.21.15.38:0/1813602424 >> v2:172.21.15.81:3300/0 conn(0x7fe24c0ba7f0 0x7fe24c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- 172.21.15.38:0/1813602424 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c149980 0x7fe24c0c09d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- 172.21.15.38:0/1813602424 >> 172.21.15.38:0/1813602424 conn(0x7fe24c0bfe30 msgr2=0x7fe24c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- 172.21.15.38:0/1813602424 shutdown_connections 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- 172.21.15.38:0/1813602424 wait complete. 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 Processor -- start 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- start start 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c06c4b0 0x7fe24c148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c149980 0x7fe24c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c148da0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1412b0 con 0x7fe24c149980 2023-06-23T18:50:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe25203f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1483d0 con 0x7fe24c06c4b0 2023-06-23T18:50:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51492/0 (socket says 172.21.15.38:51492) 2023-06-23T18:50:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c06c4b0 0x7fe24c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24affd640 1 -- 172.21.15.38:0/2881362032 learned_addr learned my addr 172.21.15.38:0/2881362032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.293+0000 7fe24bfff640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c149980 0x7fe24c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 -- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c06c4b0 msgr2=0x7fe24c148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c06c4b0 0x7fe24c148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 -- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c149980 msgr2=0x7fe24c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c149980 0x7fe24c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 -- 172.21.15.38:0/2881362032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009a70 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24affd640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe24001a170 tx=0x7fe2400192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400b4840 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2400b49a0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2400b4d50 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2400094d0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c06eda0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c148560 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2400b2040 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 0x7fe238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe24011e050 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24b7fe640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 0x7fe238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.297+0000 7fe24b7fe640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 0x7fe238068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0011f0 tx=0x7fe23c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.301+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2400eb270 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.453+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe24c04d790 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.457+0000 7fe233fff640 1 -- 172.21.15.38:0/2881362032 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2400b80a0 con 0x7fe24c0ba7f0 2023-06-23T18:50:03.464 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:03.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 msgr2=0x7fe238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 0x7fe238068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0011f0 tx=0x7fe23c007d40 comp rx=0 tx=0).stop 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 msgr2=0x7fe24c155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe24001a170 tx=0x7fe2400192e0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 shutdown_connections 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe238066280 0x7fe238068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe24c149980 0x7fe24c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe24c0ba7f0 0x7fe24c155d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 --2- 172.21.15.38:0/2881362032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe24c06c4b0 0x7fe24c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 >> 172.21.15.38:0/2881362032 conn(0x7fe24c0bfe30 msgr2=0x7fe24c141f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 shutdown_connections 2023-06-23T18:50:03.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.461+0000 7fe25203f640 1 -- 172.21.15.38:0/2881362032 wait complete. 2023-06-23T18:50:03.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:50:03.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.597+0000 7f2f55bb7640 1 Processor -- start 2023-06-23T18:50:03.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.597+0000 7f2f55bb7640 1 -- start start 2023-06-23T18:50:03.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f55bb7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f500bd1e0 0x7f2f5014c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f55bb7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f5006a630 0x7f2f5014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f55bb7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500ba9d0 con 0x7f2f5014b930 2023-06-23T18:50:03.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f55bb7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500bc300 con 0x7f2f5006a630 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f55bb7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500a5570 con 0x7f2f500bd1e0 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f5006a630 0x7f2f5014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f5006a630 0x7f2f5014c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51498/0 (socket says 172.21.15.38:51498) 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 -- 172.21.15.38:0/613706645 learned_addr learned my addr 172.21.15.38:0/613706645 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4f7fe640 1 --1- 172.21.15.38:0/613706645 >> v1:172.21.15.38:6789/0 conn(0x7f2f5014b930 0x7f2f5006c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39778/0 (socket says 172.21.15.38:39778) 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4effd640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f500bd1e0 0x7f2f5014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 -- 172.21.15.38:0/613706645 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f500bd1e0 msgr2=0x7f2f5014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:03.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f500bd1e0 0x7f2f5014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 -- 172.21.15.38:0/613706645 >> v1:172.21.15.38:6789/0 conn(0x7f2f5014b930 legacy=0x7f2f5006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 -- 172.21.15.38:0/613706645 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50150160 con 0x7f2f5006a630 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4ffff640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f5014c8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009870 tx=0x7f2f4801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2483e8c58e3f0258 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4e7fc640 1 -- 172.21.15.38:0/613706645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480ac620 con 0x7f2f5006a630 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4e7fc640 1 -- 172.21.15.38:0/613706645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480ac780 con 0x7f2f5006a630 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.601+0000 7f2f4e7fc640 1 -- 172.21.15.38:0/613706645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480acb10 con 0x7f2f5006a630 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/613706645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 msgr2=0x7f2f5014c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f5014c8d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009870 tx=0x7f2f4801c4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/613706645 shutdown_connections 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f5014c8d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/613706645 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f500bd1e0 0x7f2f5014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/613706645 >> 172.21.15.38:0/613706645 conn(0x7f2f500c0c90 msgr2=0x7f2f500bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/613706645 shutdown_connections 2023-06-23T18:50:03.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/613706645 wait complete. 2023-06-23T18:50:03.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 Processor -- start 2023-06-23T18:50:03.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- start start 2023-06-23T18:50:03.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 0x7f2f50135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 0x7f2f50135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501509f0 con 0x7f2f5006a630 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50148b30 con 0x7f2f500bd1e0 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f501469c0 con 0x7f2f5014b930 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51508/0 (socket says 172.21.15.38:51508) 2023-06-23T18:50:03.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 -- 172.21.15.38:0/3806643217 learned_addr learned my addr 172.21.15.38:0/3806643217 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4ffff640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 0x7f2f50135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4effd640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 0x7f2f50135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 -- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 msgr2=0x7f2f50135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 0x7f2f50135760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 -- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 msgr2=0x7f2f50135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 0x7f2f50135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 -- 172.21.15.38:0/3806643217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480094d0 con 0x7f2f5006a630 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4ffff640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 0x7f2f50135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4effd640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 0x7f2f50135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f4f7fe640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c430 tx=0x7f2f3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380074e0 con 0x7f2f5006a630 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38007640 con 0x7f2f5006a630 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5006cd00 con 0x7f2f5006a630 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38004a10 con 0x7f2f5006a630 2023-06-23T18:50:03.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5014de70 con 0x7f2f5006a630 2023-06-23T18:50:03.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.605+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5014ed20 con 0x7f2f5006a630 2023-06-23T18:50:03.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.609+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f38004b70 con 0x7f2f5006a630 2023-06-23T18:50:03.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.609+0000 7f2f47fff640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 0x7f2f30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.609+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f38083a20 con 0x7f2f5006a630 2023-06-23T18:50:03.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.609+0000 7f2f4effd640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 0x7f2f30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.609+0000 7f2f4effd640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 0x7f2f30068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f5006f400 tx=0x7f2f4000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.613+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f38050bb0 con 0x7f2f5006a630 2023-06-23T18:50:03.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.789+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f5004d790 con 0x7f2f5006a630 2023-06-23T18:50:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f47fff640 1 -- 172.21.15.38:0/3806643217 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7f2f380541d0 con 0x7f2f5006a630 2023-06-23T18:50:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:03.798 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:50:03.799 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:50:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 msgr2=0x7f2f30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 0x7f2f30068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f5006f400 tx=0x7f2f4000b040 comp rx=0 tx=0).stop 2023-06-23T18:50:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 msgr2=0x7f2f501485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c430 tx=0x7f2f3800c8f0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 shutdown_connections 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f30066280 0x7f2f30068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f5014b930 0x7f2f50135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f500bd1e0 0x7f2f50135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 --2- 172.21.15.38:0/3806643217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f5006a630 0x7f2f501485f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 >> 172.21.15.38:0/3806643217 conn(0x7f2f500c0c90 msgr2=0x7f2f5014c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 shutdown_connections 2023-06-23T18:50:03.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.793+0000 7f2f55bb7640 1 -- 172.21.15.38:0/3806643217 wait complete. 2023-06-23T18:50:03.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:03.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.929+0000 7f1e15b50640 1 Processor -- start 2023-06-23T18:50:03.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.929+0000 7f1e15b50640 1 -- start start 2023-06-23T18:50:03.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 0x7f1e100ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e100bc2e0 0x7f1e10151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1006e1f0 con 0x7f1e10152130 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1006e4d0 con 0x7f1e100bc2e0 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1006e7b0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e100bc2e0 0x7f1e10151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e100bc2e0 0x7f1e10151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51514/0 (socket says 172.21.15.38:51514) 2023-06-23T18:50:03.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 -- 172.21.15.38:0/3535975381 learned_addr learned my addr 172.21.15.38:0/3535975381 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0f7fe640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 0x7f1e100ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 -- 172.21.15.38:0/3535975381 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 msgr2=0x7f1e100ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 0x7f1e100ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 -- 172.21.15.38:0/3535975381 >> v1:172.21.15.81:6789/0 conn(0x7f1e10152130 legacy=0x7f1e10155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 -- 172.21.15.38:0/3535975381 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1006caa0 con 0x7f1e100bc2e0 2023-06-23T18:50:03.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0f7fe640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 0x7f1e100ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:03.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0effd640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e100bc2e0 0x7f1e10151bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009870 tx=0x7f1e0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2627e981f407b004 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0e7fc640 1 -- 172.21.15.38:0/3535975381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e040ab600 con 0x7f1e100bc2e0 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0e7fc640 1 -- 172.21.15.38:0/3535975381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040a7050 con 0x7f1e100bc2e0 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e0e7fc640 1 -- 172.21.15.38:0/3535975381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e040ab980 con 0x7f1e100bc2e0 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- 172.21.15.38:0/3535975381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e100bc2e0 msgr2=0x7f1e10151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e100bc2e0 0x7f1e10151bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009870 tx=0x7f1e0401c500 comp rx=0 tx=0).stop 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- 172.21.15.38:0/3535975381 shutdown_connections 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e100bc2e0 0x7f1e10151bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 --2- 172.21.15.38:0/3535975381 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e1006c6d0 0x7f1e100ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- 172.21.15.38:0/3535975381 >> 172.21.15.38:0/3535975381 conn(0x7f1e100c0c90 msgr2=0x7f1e100bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:03.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- 172.21.15.38:0/3535975381 shutdown_connections 2023-06-23T18:50:03.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.933+0000 7f1e15b50640 1 -- 172.21.15.38:0/3535975381 wait complete. 2023-06-23T18:50:03.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 Processor -- start 2023-06-23T18:50:03.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- start start 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e100bc2e0 0x7f1e101547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e10152130 0x7f1e10154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1014c010 con 0x7f1e1006c6d0 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10154310 con 0x7f1e100bc2e0 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101558a0 con 0x7f1e10152130 2023-06-23T18:50:03.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51528/0 (socket says 172.21.15.38:51528) 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 -- 172.21.15.38:0/1931888464 learned_addr learned my addr 172.21.15.38:0/1931888464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0effd640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e100bc2e0 0x7f1e101547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0ffff640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e10152130 0x7f1e10154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 -- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e10152130 msgr2=0x7f1e10154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e10152130 0x7f1e10154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 -- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e100bc2e0 msgr2=0x7f1e101547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:03.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e100bc2e0 0x7f1e101547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 -- 172.21.15.38:0/1931888464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040094d0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e0f7fe640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000c7f0 tx=0x7f1e0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000cea0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00007a30 con 0x7f1e1006c6d0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e10153c20 con 0x7f1e1006c6d0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00007de0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e101edeb0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.937+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e101510a0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.941+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e000113f0 con 0x7f1e1006c6d0 2023-06-23T18:50:03.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.941+0000 7f1df7fff640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 0x7f1dfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:03.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.941+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e00084390 con 0x7f1e1006c6d0 2023-06-23T18:50:03.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.941+0000 7f1e0effd640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 0x7f1dfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:03.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.941+0000 7f1e0effd640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 0x7f1dfc068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e040ad000 tx=0x7f1e040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:03.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:03.945+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e00051660 con 0x7f1e1006c6d0 2023-06-23T18:50:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.097+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1004d790 con 0x7f1e1006c6d0 2023-06-23T18:50:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.097+0000 7f1df7fff640 1 -- 172.21.15.38:0/1931888464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f1e00054c80 con 0x7f1e1006c6d0 2023-06-23T18:50:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:04.105 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 msgr2=0x7f1dfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 0x7f1dfc068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e040ad000 tx=0x7f1e040a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 msgr2=0x7f1e10150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000c7f0 tx=0x7f1e0000ccb0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 shutdown_connections 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1dfc066280 0x7f1dfc068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e10152130 0x7f1e10154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e100bc2e0 0x7f1e101547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 --2- 172.21.15.38:0/1931888464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e1006c6d0 0x7f1e10150b60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 >> 172.21.15.38:0/1931888464 conn(0x7f1e100c0c90 msgr2=0x7f1e100bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 shutdown_connections 2023-06-23T18:50:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.101+0000 7f1e15b50640 1 -- 172.21.15.38:0/1931888464 wait complete. 2023-06-23T18:50:04.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:50:04.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 Processor -- start 2023-06-23T18:50:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 -- start start 2023-06-23T18:50:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa7d80bff90 0x7fa7d80c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a3090 0x7fa7d814e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80bada0 con 0x7fa7d80a35e0 2023-06-23T18:50:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d80c2ff0 con 0x7fa7d80bff90 2023-06-23T18:50:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7de07e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80a3d10 con 0x7fa7d80a3090 2023-06-23T18:50:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa7d80bff90 0x7fa7d80c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa7d80bff90 0x7fa7d80c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51542/0 (socket says 172.21.15.38:51542) 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 -- 172.21.15.38:0/2556938428 learned_addr learned my addr 172.21.15.38:0/2556938428 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d7fff640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a3090 0x7fa7d814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 -- 172.21.15.38:0/2556938428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a3090 msgr2=0x7fa7d814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a3090 0x7fa7d814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 -- 172.21.15.38:0/2556938428 >> v1:172.21.15.81:6789/0 conn(0x7fa7d80a35e0 legacy=0x7fa7d814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.241+0000 7fa7d77fe640 1 -- 172.21.15.38:0/2556938428 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80c2540 con 0x7fa7d80bff90 2023-06-23T18:50:04.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d77fe640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d80c2ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009870 tx=0x7fa7c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef22c603eb74b53 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d67fc640 1 -- 172.21.15.38:0/2556938428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a89b0 con 0x7fa7d80bff90 2023-06-23T18:50:04.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d67fc640 1 -- 172.21.15.38:0/2556938428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a8b10 con 0x7fa7d80bff90 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d67fc640 1 -- 172.21.15.38:0/2556938428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a8ea0 con 0x7fa7d80bff90 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2556938428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 msgr2=0x7fa7d80c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d80c2ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009870 tx=0x7fa7c801ecf0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2556938428 shutdown_connections 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a3090 0x7fa7d814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2556938428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d80c2ab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2556938428 >> 172.21.15.38:0/2556938428 conn(0x7fa7d806a0d0 msgr2=0x7fa7d806a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2556938428 shutdown_connections 2023-06-23T18:50:04.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2556938428 wait complete. 2023-06-23T18:50:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 Processor -- start 2023-06-23T18:50:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- start start 2023-06-23T18:50:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d80a3090 0x7fa7d80bc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a35e0 0x7fa7d80a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80bcc80 con 0x7fa7d80bff90 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81e7b80 con 0x7fa7d80a3090 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80a91e0 con 0x7fa7d80a35e0 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51548/0 (socket says 172.21.15.38:51548) 2023-06-23T18:50:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 -- 172.21.15.38:0/2599724654 learned_addr learned my addr 172.21.15.38:0/2599724654 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 -- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a35e0 msgr2=0x7fa7d80a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d6ffd640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a35e0 0x7fa7d80a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a35e0 0x7fa7d80a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 -- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d80a3090 msgr2=0x7fa7d80bc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d80a3090 0x7fa7d80bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 -- 172.21.15.38:0/2599724654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80094d0 con 0x7fa7d80bff90 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7d7fff640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000d830 tx=0x7fa7d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000b6c0 con 0x7fa7d80bff90 2023-06-23T18:50:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000b820 con 0x7fa7d80bff90 2023-06-23T18:50:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000bbd0 con 0x7fa7d80bff90 2023-06-23T18:50:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d80bce80 con 0x7fa7d80bff90 2023-06-23T18:50:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.245+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d80bd1d0 con 0x7fa7d80bff90 2023-06-23T18:50:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d804d790 con 0x7fa7d80bff90 2023-06-23T18:50:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7d001e460 con 0x7fa7d80bff90 2023-06-23T18:50:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7cffff640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7d0085170 con 0x7fa7d80bff90 2023-06-23T18:50:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7d77fe640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.249+0000 7fa7d77fe640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 0x7fa7b8068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80b2000 tx=0x7fa7c8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.253+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7d0052490 con 0x7fa7d80bff90 2023-06-23T18:50:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d80b9960 con 0x7fa7d80bff90 2023-06-23T18:50:04.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7cffff640 1 -- 172.21.15.38:0/2599724654 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7fa7d0055ab0 con 0x7fa7d80bff90 2023-06-23T18:50:04.439 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:04.439 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:50:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:50:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 msgr2=0x7fa7b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 0x7fa7b8068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80b2000 tx=0x7fa7c8004740 comp rx=0 tx=0).stop 2023-06-23T18:50:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 msgr2=0x7fa7d814b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000d830 tx=0x7fa7d000dcf0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 shutdown_connections 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7d80bff90 0x7fa7d814b2d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d80a35e0 0x7fa7d80a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 --2- 172.21.15.38:0/2599724654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d80a3090 0x7fa7d80bc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 >> 172.21.15.38:0/2599724654 conn(0x7fa7d806a0d0 msgr2=0x7fa7d80a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 shutdown_connections 2023-06-23T18:50:04.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.433+0000 7fa7de07e640 1 -- 172.21.15.38:0/2599724654 wait complete. 2023-06-23T18:50:04.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T18:49:36.741321+0000', 'modified': '2023-06-23T18:49:53.368155+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6833/4127630669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4127630669}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4127630669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-23T18:50:04.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T18:50:04.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-23T18:50:04.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 Processor -- start 2023-06-23T18:50:04.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 -- start start 2023-06-23T18:50:04.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40a30c0 0x7f9fc40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9fc40c0c70 0x7f9fc40bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc4152830 con 0x7f9fc40bea40 2023-06-23T18:50:04.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40bf350 con 0x7f9fc40c0c70 2023-06-23T18:50:04.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fcbb90640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c22a0 con 0x7f9fc40a30c0 2023-06-23T18:50:04.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9fc40c0c70 0x7f9fc40bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9fc40c0c70 0x7f9fc40bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51556/0 (socket says 172.21.15.38:51556) 2023-06-23T18:50:04.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 -- 172.21.15.38:0/550129293 learned_addr learned my addr 172.21.15.38:0/550129293 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fc992c640 1 --1- 172.21.15.38:0/550129293 >> v1:172.21.15.38:6789/0 conn(0x7f9fc40bea40 0x7f9fc406a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39784/0 (socket says 172.21.15.38:39784) 2023-06-23T18:50:04.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fc912b640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40a30c0 0x7f9fc40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 -- 172.21.15.38:0/550129293 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40a30c0 msgr2=0x7f9fc40a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40a30c0 0x7f9fc40a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 -- 172.21.15.38:0/550129293 >> v1:172.21.15.38:6789/0 conn(0x7f9fc40bea40 legacy=0x7f9fc406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fca12d640 1 -- 172.21.15.38:0/550129293 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40c2870 con 0x7f9fc40c0c70 2023-06-23T18:50:04.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.781+0000 7f9fc892a640 1 -- 172.21.15.38:0/550129293 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682060651 0 0) 0x7f9fc4152830 con 0x7f9fc40bea40 2023-06-23T18:50:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fca12d640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40c0c70 0x7f9fc40bee10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009e50 tx=0x7f9fbc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5bc873141e8fd9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc892a640 1 -- 172.21.15.38:0/550129293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0a5640 con 0x7f9fc40c0c70 2023-06-23T18:50:04.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc892a640 1 -- 172.21.15.38:0/550129293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0a57a0 con 0x7f9fc40c0c70 2023-06-23T18:50:04.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc892a640 1 -- 172.21.15.38:0/550129293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0a5b30 con 0x7f9fc40c0c70 2023-06-23T18:50:04.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- 172.21.15.38:0/550129293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40c0c70 msgr2=0x7f9fc40bee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40c0c70 0x7f9fc40bee10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009e50 tx=0x7f9fbc01c950 comp rx=0 tx=0).stop 2023-06-23T18:50:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- 172.21.15.38:0/550129293 shutdown_connections 2023-06-23T18:50:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40c0c70 0x7f9fc40bee10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/550129293 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40a30c0 0x7f9fc40a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- 172.21.15.38:0/550129293 >> 172.21.15.38:0/550129293 conn(0x7f9fc40a5cc0 msgr2=0x7f9fc40a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- 172.21.15.38:0/550129293 shutdown_connections 2023-06-23T18:50:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- 172.21.15.38:0/550129293 wait complete. 2023-06-23T18:50:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 Processor -- start 2023-06-23T18:50:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- start start 2023-06-23T18:50:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 0x7f9fc414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40c0c70 0x7f9fc40b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc414dbb0 con 0x7f9fc40bea40 2023-06-23T18:50:04.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc414d580 con 0x7f9fc40a30c0 2023-06-23T18:50:04.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fcbb90640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc414d7d0 con 0x7f9fc40c0c70 2023-06-23T18:50:04.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc912b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc912b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51560/0 (socket says 172.21.15.38:51560) 2023-06-23T18:50:04.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc912b640 1 -- 172.21.15.38:0/4049602124 learned_addr learned my addr 172.21.15.38:0/4049602124 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fca12d640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40c0c70 0x7f9fc40b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.785+0000 7f9fc992c640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 0x7f9fc414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 -- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40c0c70 msgr2=0x7f9fc40b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40c0c70 0x7f9fc40b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 -- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 msgr2=0x7f9fc414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 0x7f9fc414c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 -- 172.21.15.38:0/4049602124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc009b30 con 0x7f9fc40bea40 2023-06-23T18:50:04.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc992c640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 0x7f9fc414c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc912b640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e870 tx=0x7f9fb400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 -- 172.21.15.38:0/4049602124 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4009510 con 0x7f9fc40bea40 2023-06-23T18:50:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 -- 172.21.15.38:0/4049602124 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb400eec0 con 0x7f9fc40bea40 2023-06-23T18:50:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 -- 172.21.15.38:0/4049602124 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400cb40 con 0x7f9fc40bea40 2023-06-23T18:50:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc414b4a0 con 0x7f9fc40bea40 2023-06-23T18:50:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc414d110 con 0x7f9fc40bea40 2023-06-23T18:50:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 -- 172.21.15.38:0/4049602124 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fb400cca0 con 0x7f9fc40bea40 2023-06-23T18:50:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 0x7f9fa8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fba7fc640 1 -- 172.21.15.38:0/4049602124 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fb40840e0 con 0x7f9fc40bea40 2023-06-23T18:50:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc992c640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 0x7f9fa8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fcecac000 1 Processor -- start 2023-06-23T18:50:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fcecac000 1 -- start start 2023-06-23T18:50:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.789+0000 7f9fc992c640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 0x7f9fa8068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000f70 tx=0x7f9fc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x564257385860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x564257386170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425724cac0 con 0x5642573be5d0 2023-06-23T18:50:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564257186840 con 0x564257385da0 2023-06-23T18:50:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642571da2e0 con 0x564257385490 2023-06-23T18:50:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51574/0 (socket says 172.21.15.38:51574) 2023-06-23T18:50:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 -- 172.21.15.38:0/982353415 learned_addr learned my addr 172.21.15.38:0/982353415 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x564257385860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fca12d640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x564257386170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 -- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 msgr2=0x564257385860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x564257385860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 -- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 msgr2=0x564257386170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x564257386170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 -- 172.21.15.38:0/982353415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564256ecf890 con 0x5642573be5d0 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fca12d640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x564257386170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0007360 tx=0x7f9fc0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880a9c2540fa68c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa77fe640 1 -- 172.21.15.38:0/982353415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0001d90 con 0x5642573be5d0 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa77fe640 1 -- 172.21.15.38:0/982353415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc000db80 con 0x5642573be5d0 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa77fe640 1 -- 172.21.15.38:0/982353415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0005e40 con 0x5642573be5d0 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/982353415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 msgr2=0x564257384f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0007360 tx=0x7f9fc0010000 comp rx=0 tx=0).stop 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/982353415 shutdown_connections 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x564257386170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x564257385860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- 172.21.15.38:0/982353415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x564257384f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/982353415 >> 172.21.15.38:0/982353415 conn(0x56425737ca10 msgr2=0x564257383830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/982353415 shutdown_connections 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/982353415 wait complete. 2023-06-23T18:50:04.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- start start 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 Processor -- start 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385490 0x56425738b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5642573be5d0 0x5642573bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642571d3380 con 0x564257385da0 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425718fae0 con 0x564257385490 2023-06-23T18:50:04.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x56425718f780 con 0x5642573be5d0 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 10 client.0 _ll_register_callbacks cb 0x564257370e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51584/0 (socket says 172.21.15.38:51584) 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 -- 172.21.15.38:0/2350233956 learned_addr learned my addr 172.21.15.38:0/2350233956 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fca12d640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5642573be5d0 0x5642573bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc992c640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385490 0x56425738b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 -- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5642573be5d0 msgr2=0x5642573bf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5642573be5d0 0x5642573bf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 -- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385490 msgr2=0x56425738b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385490 0x56425738b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 -- 172.21.15.38:0/2350233956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc00070d0 con 0x564257385da0 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fc912b640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c10 tx=0x7f9fb405d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a13a83778c8b53 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4050db0 con 0x564257385da0 2023-06-23T18:50:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56425719aa20 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fb4050f10 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb40510d0 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 10 client.4863 fetch_fsmap learned FSMap version 8 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.793+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564257197d10 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56425719aa20 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 8) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f9fb4011070 con 0x564257385da0 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 10 client.4863 fetch_fsmap finished waiting for FSMap version 8 2023-06-23T18:50:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 10 client.4863 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 20 client.4863 populate_metadata read hostname 'smithi038' 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642573bd880 0x5642573bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 4 client.4863 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 --> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564257202710 con 0x5642573bd880 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fc992c640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642573bd880 0x5642573bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 10 client.4863 ms_handle_connect on v2:172.21.15.38:6832/4127630669 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fc992c640 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642573bd880 0x5642573bdc50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a8404ea38d7d68 server_cookie=3792a6381b73707d in_seq=0 out_seq=0 2023-06-23T18:50:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/2350233956 <== mds.0 v2:172.21.15.38:6832/4127630669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564257202710 con 0x5642573bd880 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 10 client.4863 handle_command_reply: tid=0 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 client.4863 shutdown 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 msgr2=0x5642573bf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4000c10 tx=0x7f9fb405d470 comp rx=0 tx=0).stop 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 shutdown_connections 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642573bd880 0x5642573bdc50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5642573be5d0 0x5642573bf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385da0 0x5642573bf2b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 --2- 172.21.15.38:0/2350233956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385490 0x56425738b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fa4ff9640 0 client.4863 ms_handle_reset on v2:172.21.15.38:6832/4127630669 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 >> 172.21.15.38:0/2350233956 conn(0x56425737ca10 msgr2=0x564257383830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 shutdown_connections 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 1 -- 172.21.15.38:0/2350233956 wait complete. 2023-06-23T18:50:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.797+0000 7f9fcecac000 20 client.4863 trim_cache size 0 max 16384 2023-06-23T18:50:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 Processor -- start 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- start start 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385da0 0x5642573866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642573be5d0 0x564257386bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256e90940 con 0x564257385490 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425717b450 con 0x5642573be5d0 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x564257271f00 con 0x564257385da0 2023-06-23T18:50:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51586/0 (socket says 172.21.15.38:51586) 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 -- 172.21.15.38:0/527054779 learned_addr learned my addr 172.21.15.38:0/527054779 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 -- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385da0 msgr2=0x5642573866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385da0 0x5642573866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 -- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642573be5d0 msgr2=0x564257386bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642573be5d0 0x564257386bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 -- 172.21.15.38:0/527054779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56425717dfa0 con 0x564257385490 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fc992c640 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009010 tx=0x7f9fc0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4d65636741fd7e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fa7fff640 1 -- 172.21.15.38:0/527054779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000dba0 con 0x564257385490 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fa7fff640 1 -- 172.21.15.38:0/527054779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0018040 con 0x564257385490 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fa7fff640 1 -- 172.21.15.38:0/527054779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc002e9d0 con 0x564257385490 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- 172.21.15.38:0/527054779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 msgr2=0x564257386170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009010 tx=0x7f9fc0007000 comp rx=0 tx=0).stop 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- 172.21.15.38:0/527054779 shutdown_connections 2023-06-23T18:50:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5642573be5d0 0x564257386bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385da0 0x5642573866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- 172.21.15.38:0/527054779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564257385490 0x564257386170 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- 172.21.15.38:0/527054779 >> 172.21.15.38:0/527054779 conn(0x56425737ca10 msgr2=0x5642573ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- 172.21.15.38:0/527054779 shutdown_connections 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- 172.21.15.38:0/527054779 wait complete. 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- start start 2023-06-23T18:50:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 Processor -- start 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x5642573d63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x5642573d68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x564257194730 con 0x5642573be5d0 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56425722be30 con 0x564257385da0 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.813+0000 7f9fcecac000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x564257194940 con 0x564257385490 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 10 client.0 _ll_register_callbacks cb 0x5642571a56c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:50:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51602/0 (socket says 172.21.15.38:51602) 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 -- 172.21.15.38:0/1388857769 learned_addr learned my addr 172.21.15.38:0/1388857769 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fc912b640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x5642573d68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fc992c640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x5642573d63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 -- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 msgr2=0x5642573d63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x5642573d63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 -- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 msgr2=0x5642573d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:04.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x5642573d68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 -- 172.21.15.38:0/1388857769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564256ecf890 con 0x5642573be5d0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fca12d640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc01a580 tx=0x7f9fbc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24aa82d9da69950 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0a5c10 con 0x5642573be5d0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fbc0a5d70 con 0x5642573be5d0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564257389020 con 0x5642573be5d0 2023-06-23T18:50:04.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fbc0c8420 con 0x5642573be5d0 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 10 client.4869 fetch_fsmap learned FSMap version 8 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564256ecfcc0 con 0x5642573be5d0 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564257389020 con 0x5642573be5d0 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 8) v1 ==== 2032+0+0 (secure 0 0 0) 0x7f9fbc0cd200 con 0x5642573be5d0 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 10 client.4869 fetch_fsmap finished waiting for FSMap version 8 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 10 client.4869 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 20 client.4869 populate_metadata read hostname 'smithi038' 2023-06-23T18:50:04.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642574271f0 0x5642574295d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 4 client.4869 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 --> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5642571d1cd0 con 0x5642574271f0 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fc992c640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642574271f0 0x5642574295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fc992c640 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642574271f0 0x5642574295d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83ae7b8459de388 server_cookie=7fb9edad106047ea in_seq=0 out_seq=0 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 10 client.4869 ms_handle_connect on v2:172.21.15.38:6832/4127630669 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 1 -- 172.21.15.38:0/1388857769 <== mds.0 v2:172.21.15.38:6832/4127630669 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5642571d1cd0 con 0x5642574271f0 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 10 client.4869 handle_command_reply: tid=0 2023-06-23T18:50:04.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 client.4869 shutdown 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 msgr2=0x5642573d6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc01a580 tx=0x7f9fbc0196f0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 shutdown_connections 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:6832/4127630669,v1:172.21.15.38:6833/4127630669] conn(0x5642574271f0 0x5642574295d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642573be5d0 0x5642573d6e20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564257385da0 0x5642573d68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fa4ff9640 0 client.4869 ms_handle_reset on v2:172.21.15.38:6832/4127630669 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 --2- 172.21.15.38:0/1388857769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x564257385490 0x5642573d63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 >> 172.21.15.38:0/1388857769 conn(0x56425737ca10 msgr2=0x5642573ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 shutdown_connections 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 1 -- 172.21.15.38:0/1388857769 wait complete. 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcecac000 20 client.4869 trim_cache size 0 max 16384 2023-06-23T18:50:04.848 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5", 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4266, 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-06-23T18:50:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 28.075732425000002, 2023-06-23T18:50:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 8, 2023-06-23T18:50:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 28, 2023-06-23T18:50:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 28, 2023-06-23T18:50:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 32.382138017000003 2023-06-23T18:50:04.850 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:04.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 msgr2=0x7f9fa8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 0x7f9fa8068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000f70 tx=0x7f9fc0009040 comp rx=0 tx=0).stop 2023-06-23T18:50:04.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 msgr2=0x7f9fc414af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e870 tx=0x7f9fb400ec70 comp rx=0 tx=0).stop 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 shutdown_connections 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9fa8066280 0x7f9fa8068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9fc40c0c70 0x7f9fc40b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc40bea40 0x7f9fc414af60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 --2- 172.21.15.38:0/4049602124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fc40a30c0 0x7f9fc414c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:04.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 >> 172.21.15.38:0/4049602124 conn(0x7f9fc40a5cc0 msgr2=0x7f9fc414f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:04.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 shutdown_connections 2023-06-23T18:50:04.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:04.817+0000 7f9fcbb90640 1 -- 172.21.15.38:0/4049602124 wait complete. 2023-06-23T18:50:04.853 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-06-23T18:50:04.863 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-06-23T18:50:04.864 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2023-06-23T18:50:04.864 INFO:tasks.ceph_fuse:client.0 config is {} 2023-06-23T18:50:04.864 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T18:50:04.864 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:04.864 INFO:tasks.ceph_fuse:client.1 config is {} 2023-06-23T18:50:04.865 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T18:50:04.865 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:04.865 INFO:tasks.ceph_fuse:client.2 config is {} 2023-06-23T18:50:04.865 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T18:50:04.865 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:04.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:04.866 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-06-23T18:50:04.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:04.873 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-06-23T18:50:04.933 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2023-06-23T18:50:04.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:50:04.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:04.936 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-06-23T18:50:04.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:04.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-06-23T18:50:05.003 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-06-23T18:50:05.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:50:05.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.005 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-06-23T18:50:05.011 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-23T18:50:05.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-23T18:50:05.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.073 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-06-23T18:50:05.261 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-06-23T18:50:05.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:50:05.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.385+0000 7fe3db9c5640 1 Processor -- start 2023-06-23T18:50:05.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.385+0000 7fe3db9c5640 1 -- start start 2023-06-23T18:50:05.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3db9c5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3d414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3db9c5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40ba9d0 con 0x7fe3d414b930 2023-06-23T18:50:05.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3db9c5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d4150160 con 0x7fe3d40bd1e0 2023-06-23T18:50:05.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3db9c5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40bc300 con 0x7fe3d406a630 2023-06-23T18:50:05.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9761640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe3d414b930 0x7fe3d406c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52962/0 (socket says 172.21.15.38:52962) 2023-06-23T18:50:05.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9761640 1 -- 172.21.15.38:0/3058126321 learned_addr learned my addr 172.21.15.38:0/3058126321 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:05.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3d414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791241744 0 0) 0x7fe3d40ba9d0 con 0x7fe3d414b930 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c4003530 con 0x7fe3d414b930 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60054950 0 0) 0x7fe3c4003530 con 0x7fe3d414b930 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 msgr2=0x7fe3d414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3d414caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 >> v1:172.21.15.81:6789/0 conn(0x7fe3d40bd1e0 legacy=0x7fe3d414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4150440 con 0x7fe3d414b930 2023-06-23T18:50:05.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fe3c0001680 con 0x7fe3d414b930 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 >> v1:172.21.15.38:6789/0 conn(0x7fe3d414b930 legacy=0x7fe3d406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c4003f30 0x7fe3c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3c4004d10 0x7fe3c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40bc300 con 0x7fe3c4004d10 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c400ba70 con 0x7fe3c4003f30 2023-06-23T18:50:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c400bc30 con 0x7fe3d406a630 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3c4004d10 0x7fe3c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9761640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d8f60640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c4003f30 0x7fe3c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 -- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 msgr2=0x7fe3c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406a630 0x7fe3c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 -- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c4003f30 msgr2=0x7fe3c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3c4003f30 0x7fe3c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.389+0000 7fe3d9f62640 1 -- 172.21.15.38:0/3058126321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4003530 con 0x7fe3c4004d10 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3c4004d10 0x7fe3c4005180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ab0 tx=0x7fe3cc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f606127c395ec2d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0a5620 con 0x7fe3c4004d10 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc0a5780 con 0x7fe3c4004d10 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d3fff640 1 -- 172.21.15.38:0/3058126321 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0a5b30 con 0x7fe3c4004d10 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/3058126321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3c4004d10 msgr2=0x7fe3c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/3058126321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3c4004d10 0x7fe3c4005180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ab0 tx=0x7fe3cc01ca30 comp rx=0 tx=0).stop 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d9f62640 1 -- 172.21.15.38:0/3058126321 reap_dead start 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/3058126321 shutdown_connections 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/3058126321 >> 172.21.15.38:0/3058126321 conn(0x7fe3d40c0c90 msgr2=0x7fe3d40bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/3058126321 shutdown_connections 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/3058126321 wait complete. 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 Processor -- start 2023-06-23T18:50:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- start start 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3d41e6b10 0x7fe3d41e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406fd70 0x7fe3d406e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40a5570 con 0x7fe3d409a8f0 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40bacf0 con 0x7fe3d41e6b10 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41e7640 con 0x7fe3d406fd70 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60538/0 (socket says 172.21.15.38:60538) 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 -- 172.21.15.38:0/1151616854 learned_addr learned my addr 172.21.15.38:0/1151616854 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d9f62640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406fd70 0x7fe3d406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d9761640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3d41e6b10 0x7fe3d41e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 -- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406fd70 msgr2=0x7fe3d406e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406fd70 0x7fe3d406e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 -- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3d41e6b10 msgr2=0x7fe3d41e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3d41e6b10 0x7fe3d41e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 -- 172.21.15.38:0/1151616854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d41e44b0 con 0x7fe3d409a8f0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d8f60640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800e900 tx=0x7fe3c800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8003b90 con 0x7fe3d409a8f0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8003cf0 con 0x7fe3d409a8f0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d4098a40 con 0x7fe3d409a8f0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800c9c0 con 0x7fe3d409a8f0 2023-06-23T18:50:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.393+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d4098d20 con 0x7fe3d409a8f0 2023-06-23T18:50:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d41e7780 con 0x7fe3d409a8f0 2023-06-23T18:50:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3c800cb20 con 0x7fe3d409a8f0 2023-06-23T18:50:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3d1ffb640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3c8084090 con 0x7fe3d409a8f0 2023-06-23T18:50:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3d9761640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.397+0000 7fe3d9761640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 0x7fe3b8068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0001ca0 tx=0x7fe3c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.401+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3d41e7780 con 0x7fe3d409a8f0 2023-06-23T18:50:05.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.593+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3d41e7780 con 0x7fe3d409a8f0 2023-06-23T18:50:05.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.593+0000 7fe3d1ffb640 1 -- 172.21.15.38:0/1151616854 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe3d41e7780 con 0x7fe3d409a8f0 2023-06-23T18:50:05.600 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T18:50:05.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 msgr2=0x7fe3b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 0x7fe3b8068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0001ca0 tx=0x7fe3c0009040 comp rx=0 tx=0).stop 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 msgr2=0x7fe3d4146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800e900 tx=0x7fe3c800edc0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 shutdown_connections 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe3b80662b0 0x7fe3b8068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe3d406fd70 0x7fe3d406e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3d409a8f0 0x7fe3d4146480 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 --2- 172.21.15.38:0/1151616854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3d41e6b10 0x7fe3d41e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 >> 172.21.15.38:0/1151616854 conn(0x7fe3d40c0c90 msgr2=0x7fe3d40bb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 shutdown_connections 2023-06-23T18:50:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:05.597+0000 7fe3db9c5640 1 -- 172.21.15.38:0/1151616854 wait complete. 2023-06-23T18:50:05.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T18:50:05.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:50:05.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-06-23T18:50:05.621 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-23T18:50:05.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:05.621 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T18:50:05.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T18:50:05.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:50:05.622 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:50:05.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.622 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-06-23T18:50:05.629 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:50:05.630 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:50:05.630 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:50:05.630 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:05.631 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-06-23T18:50:05.631 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:05.631 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:05.631 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:05.631 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:50:05.632 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:c9:24:d8:a0 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:05.633 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-23T18:50:05.634 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:05.634 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T18:50:05.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.634 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:50:05.635 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:50:05.635 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-06-23T18:50:05.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-06-23T18:50:05.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-06-23T18:50:05.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T18:50:05.636 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:50:05.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.713 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:50:05.768 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-06-23T18:50:05.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.770 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-06-23T18:50:05.817 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-06-23T18:50:05.817 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:50:05.817 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-23T18:50:05.817 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:50:05.817 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:50:05.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.819 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:50:05.819 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:50:05.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:50:05.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:50:05.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:50:05.821 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:50:05.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.891 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-06-23T18:50:05.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.941 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-06-23T18:50:05.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:05.992 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:50:05.992 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:50:05.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T18:50:05.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-23T18:50:05.993 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:50:06.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-23T18:50:06.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:06.060 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:50:06.061 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:50:06.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-23T18:50:06.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T18:50:06.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-23T18:50:06.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-23T18:50:06.062 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-23T18:50:06.062 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:50:06.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:06.158 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-06-23T18:50:06.159 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-06-23T18:50:06.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-06-23T18:50:06.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T18:50:06.159 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-06-23T18:50:06.179 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-23T18:50:06.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:06.179 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:06.224 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:50:06.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:06.224 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:06.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:50:06.332 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:06.333 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:06.391 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:06.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:06.392 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:50:06.440 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T18:50:06.441 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-23T18:50:06.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:50:06.499 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:06.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:06.555 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:06.556 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:06.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:06.557 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:50:06.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:2023-06-23T18:50:06.561+0000 7f50e8064580 -1 init, newargv = 0x564ea8873c30 newargc=15 2023-06-23T18:50:06.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[32912]: starting ceph client 2023-06-23T18:50:06.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[32912]: starting fuse 2023-06-23T18:50:07.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-06-23T18:50:07.686 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:07.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:07.743 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:07.744 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:07.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:07.745 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-06-23T18:50:07.796 INFO:teuthology.orchestra.run.smithi118.stdout:45 2023-06-23T18:50:07.797 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-23T18:50:07.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T18:50:07.797 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-06-23T18:50:07.798 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-06-23T18:50:07.798 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-06-23T18:50:07.798 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-06-23T18:50:07.799 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:50:07.799 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-06-23T18:50:07.799 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-23T18:50:07.799 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-06-23T18:50:07.800 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-23T18:50:07.800 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:50:07.800 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-06-23T18:50:07.801 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-06-23T18:50:07.801 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-06-23T18:50:07.801 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-06-23T18:50:07.801 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:50:07.802 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-06-23T18:50:07.802 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T18:50:07.802 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T18:50:07.802 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T18:50:07.803 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-06-23T18:50:07.803 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-06-23T18:50:07.803 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-06-23T18:50:07.804 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T18:50:07.804 DEBUG:teuthology.orchestra.run.smithi118:> 2023-06-23T18:50:07.804 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.0")) 2023-06-23T18:50:07.805 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-06-23T18:50:07.916 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.0.32912.asok 2023-06-23T18:50:08.098 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32912.asok 2023-06-23T18:50:08.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.099 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32912.asok status 2023-06-23T18:50:08.252 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-06-23T18:50:08.252 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "8627af3e0adcb765a3c249fcc209cba9f4873e1b", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev)", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "0", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "32912", 2023-06-23T18:50:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4881, 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-06-23T18:50:08.254 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4881 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 514354822 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:50:08.255 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 514354822 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4881 172.21.15.118:0/514354822", 2023-06-23T18:50:08.256 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "172.21.15.118:0/514354822", 2023-06-23T18:50:08.257 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-06-23T18:50:08.257 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 8, 2023-06-23T18:50:08.257 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 28, 2023-06-23T18:50:08.257 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-06-23T18:50:08.258 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-06-23T18:50:08.258 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-06-23T18:50:08.258 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-06-23T18:50:08.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:50:08.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 Processor -- start 2023-06-23T18:50:08.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 -- start start 2023-06-23T18:50:08.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f66b00bd9b0 0x7f66b0070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:08.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b00b9ca0 con 0x7f66b006c6d0 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b00714a0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66b684b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b00a55b0 con 0x7f66b00bd9b0 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f66b00bd9b0 0x7f66b0070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f66b00bd9b0 0x7f66b0070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60546/0 (socket says 172.21.15.38:60546) 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 -- 172.21.15.38:0/104200246 learned_addr learned my addr 172.21.15.38:0/104200246 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 -- 172.21.15.38:0/104200246 >> v1:172.21.15.81:6789/0 conn(0x7f66b00bc4f0 legacy=0x7f66b014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 -- 172.21.15.38:0/104200246 >> v1:172.21.15.38:6789/0 conn(0x7f66b006c6d0 legacy=0x7f66b00a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:08.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.393+0000 7f66af7fe640 1 -- 172.21.15.38:0/104200246 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b006a3f0 con 0x7f66b00bd9b0 2023-06-23T18:50:08.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- 172.21.15.38:0/104200246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bd9b0 0x7f66b0070f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a401e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de33a3502782db2f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:08.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66aeffd640 1 -- 172.21.15.38:0/104200246 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40a8040 con 0x7f66b00bd9b0 2023-06-23T18:50:08.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66aeffd640 1 -- 172.21.15.38:0/104200246 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40ac600 con 0x7f66b00bd9b0 2023-06-23T18:50:08.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66aeffd640 1 -- 172.21.15.38:0/104200246 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40ac990 con 0x7f66b00bd9b0 2023-06-23T18:50:08.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/104200246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bd9b0 msgr2=0x7f66b0070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 --2- 172.21.15.38:0/104200246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bd9b0 0x7f66b0070f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a401e680 comp rx=0 tx=0).stop 2023-06-23T18:50:08.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/104200246 shutdown_connections 2023-06-23T18:50:08.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 --2- 172.21.15.38:0/104200246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bd9b0 0x7f66b0070f60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/104200246 >> 172.21.15.38:0/104200246 conn(0x7f66b00c0c90 msgr2=0x7f66b00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:08.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/104200246 shutdown_connections 2023-06-23T18:50:08.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/104200246 wait complete. 2023-06-23T18:50:08.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 Processor -- start 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- start start 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 0x7f66b014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 0x7f66b013c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00bfa10 con 0x7f66b00bc4f0 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0140510 con 0x7f66b006c6d0 2023-06-23T18:50:08.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b014cd20 con 0x7f66b00bd9b0 2023-06-23T18:50:08.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:08.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60550/0 (socket says 172.21.15.38:60550) 2023-06-23T18:50:08.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 -- 172.21.15.38:0/3737366975 learned_addr learned my addr 172.21.15.38:0/3737366975 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:08.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66affff640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 0x7f66b014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:08.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b4de8640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 0x7f66b013c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 -- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 msgr2=0x7f66b013c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 0x7f66b013c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 -- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 msgr2=0x7f66b014c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 0x7f66b014c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 -- 172.21.15.38:0/3737366975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40094d0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66affff640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 0x7f66b014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:08.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b4de8640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 0x7f66b013c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66af7fe640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66a401c2b0 tx=0x7f66a401cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40b6890 con 0x7f66b00bc4f0 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40b69f0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b01409a0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.397+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40b6da0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b013fec0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b004d790 con 0x7f66b00bc4f0 2023-06-23T18:50:08.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66a40b7410 con 0x7f66b00bc4f0 2023-06-23T18:50:08.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66acff9640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 0x7f669c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:08.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f66a411eca0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66affff640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 0x7f669c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:08.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.401+0000 7f66affff640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 0x7f669c068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66a00098b0 tx=0x7f66a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:08.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.405+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66a40ebfe0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.593+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66b0070be0 con 0x7f66b00bc4f0 2023-06-23T18:50:08.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66acff9640 1 -- 172.21.15.38:0/3737366975 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f66a40bb070 con 0x7f66b00bc4f0 2023-06-23T18:50:08.602 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T18:50:08.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 msgr2=0x7f669c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 0x7f669c068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f66a00098b0 tx=0x7f66a0008040 comp rx=0 tx=0).stop 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 msgr2=0x7f66b013c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f66a401c2b0 tx=0x7f66a401cec0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 shutdown_connections 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f669c066280 0x7f669c068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66b00bd9b0 0x7f66b013c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b00bc4f0 0x7f66b013c2b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 --2- 172.21.15.38:0/3737366975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66b006c6d0 0x7f66b014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 >> 172.21.15.38:0/3737366975 conn(0x7f66b00c0c90 msgr2=0x7f66b006e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 shutdown_connections 2023-06-23T18:50:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:08.597+0000 7f66b684b640 1 -- 172.21.15.38:0/3737366975 wait complete. 2023-06-23T18:50:08.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T18:50:08.621 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:50:08.621 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2023-06-23T18:50:08.621 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-23T18:50:08.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:08.621 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T18:50:08.622 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T18:50:08.622 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:50:08.622 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-23T18:50:08.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.622 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2023-06-23T18:50:08.629 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2023-06-23T18:50:08.630 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42377sec preferred_lft 42377sec 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2023-06-23T18:50:08.631 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:08.632 INFO:teuthology.orchestra.run.smithi164.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-23T18:50:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 02:42:2e:52:5d:cb brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-23T18:50:08.632 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:08.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T18:50:08.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.633 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-06-23T18:50:08.633 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-06-23T18:50:08.633 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2023-06-23T18:50:08.633 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2023-06-23T18:50:08.634 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2023-06-23T18:50:08.634 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T18:50:08.634 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-06-23T18:50:08.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.714 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:50:08.767 INFO:teuthology.orchestra.run.smithi164.stdout:1 2023-06-23T18:50:08.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.768 DEBUG:teuthology.orchestra.run.smithi164:> route 2023-06-23T18:50:08.835 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2023-06-23T18:50:08.835 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:50:08.835 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-23T18:50:08.835 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:08.836 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:50:08.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.837 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-06-23T18:50:08.837 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-06-23T18:50:08.838 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:50:08.838 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:50:08.838 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:50:08.838 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-06-23T18:50:08.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.907 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-06-23T18:50:08.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:08.954 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2023-06-23T18:50:09.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:09.001 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-06-23T18:50:09.001 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-06-23T18:50:09.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-23T18:50:09.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-23T18:50:09.002 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-06-23T18:50:09.071 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-23T18:50:09.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:09.072 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-06-23T18:50:09.072 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-06-23T18:50:09.072 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-23T18:50:09.072 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T18:50:09.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-23T18:50:09.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-23T18:50:09.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-23T18:50:09.073 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-06-23T18:50:09.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:09.176 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec bash -c ' 2023-06-23T18:50:09.176 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2023-06-23T18:50:09.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2023-06-23T18:50:09.177 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T18:50:09.177 DEBUG:teuthology.orchestra.run.smithi164:> ') 2023-06-23T18:50:09.196 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-23T18:50:09.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:09.197 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:09.241 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-23T18:50:09.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:09.241 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:09.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2023-06-23T18:50:09.339 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:09.340 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:09.390 INFO:teuthology.orchestra.run.smithi164.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:09.390 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:09.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:09.392 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2023-06-23T18:50:09.436 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T18:50:09.437 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-23T18:50:09.482 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2023-06-23T18:50:09.497 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:09.498 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:09.552 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:09.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:09.553 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2023-06-23T18:50:09.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:2023-06-23T18:50:09.583+0000 7fb978e53580 -1 init, newargv = 0x55cd608cdca0 newargc=15 2023-06-23T18:50:09.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:ceph-fuse[32754]: starting ceph client 2023-06-23T18:50:09.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:ceph-fuse[32754]: starting fuse 2023-06-23T18:50:10.695 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2023-06-23T18:50:10.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:10.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:10.765 INFO:teuthology.orchestra.run.smithi164.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:10.766 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:10.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:10.768 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2023-06-23T18:50:10.813 INFO:teuthology.orchestra.run.smithi164.stdout:45 2023-06-23T18:50:10.814 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-23T18:50:10.814 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T18:50:10.814 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2023-06-23T18:50:10.815 DEBUG:teuthology.orchestra.run.smithi164:> import re 2023-06-23T18:50:10.815 DEBUG:teuthology.orchestra.run.smithi164:> import os 2023-06-23T18:50:10.815 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2023-06-23T18:50:10.815 DEBUG:teuthology.orchestra.run.smithi164:> 2023-06-23T18:50:10.816 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2023-06-23T18:50:10.816 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-23T18:50:10.816 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2023-06-23T18:50:10.816 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-23T18:50:10.817 DEBUG:teuthology.orchestra.run.smithi164:> 2023-06-23T18:50:10.817 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2023-06-23T18:50:10.817 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2023-06-23T18:50:10.817 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2023-06-23T18:50:10.817 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2023-06-23T18:50:10.818 DEBUG:teuthology.orchestra.run.smithi164:> 2023-06-23T18:50:10.818 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2023-06-23T18:50:10.818 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T18:50:10.819 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T18:50:10.819 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T18:50:10.820 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2023-06-23T18:50:10.820 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2023-06-23T18:50:10.820 DEBUG:teuthology.orchestra.run.smithi164:> return f 2023-06-23T18:50:10.820 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T18:50:10.820 DEBUG:teuthology.orchestra.run.smithi164:> 2023-06-23T18:50:10.821 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.1")) 2023-06-23T18:50:10.821 DEBUG:teuthology.orchestra.run.smithi164:> ' 2023-06-23T18:50:10.933 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.1.32754.asok 2023-06-23T18:50:11.115 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32754.asok 2023-06-23T18:50:11.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.116 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32754.asok status 2023-06-23T18:50:11.270 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2023-06-23T18:50:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2023-06-23T18:50:11.270 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "8627af3e0adcb765a3c249fcc209cba9f4873e1b", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev)", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "1", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "32754", 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/" 2023-06-23T18:50:11.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4619, 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2023-06-23T18:50:11.272 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 4619 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 1427908279 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2023-06-23T18:50:11.273 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 1427908279 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.4619 172.21.15.164:0/1427908279", 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "172.21.15.164:0/1427908279", 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 1, 2023-06-23T18:50:11.274 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 8, 2023-06-23T18:50:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 28, 2023-06-23T18:50:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2023-06-23T18:50:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "blocklisted": false, 2023-06-23T18:50:11.275 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2023-06-23T18:50:11.275 INFO:teuthology.orchestra.run.smithi164.stdout:} 2023-06-23T18:50:11.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:50:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.408+0000 7f07c4e5d640 1 Processor -- start 2023-06-23T18:50:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.408+0000 7f07c4e5d640 1 -- start start 2023-06-23T18:50:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07c4e5d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07c006b7a0 0x7f07c00babb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07c4e5d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c014f570 con 0x7f07c00714d0 2023-06-23T18:50:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07c4e5d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00bcac0 con 0x7f07c00a5920 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07c4e5d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b6100 con 0x7f07c006b7a0 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bdd9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f07c00714d0 0x7f07c014ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52974/0 (socket says 172.21.15.38:52974) 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bdd9b640 1 -- 172.21.15.38:0/1288240873 learned_addr learned my addr 172.21.15.38:0/1288240873 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 --2- 172.21.15.38:0/1288240873 >> v2:172.21.15.81:3300/0 conn(0x7f07c006b7a0 0x7f07c00babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618040926 0 0) 0x7f07c014f570 con 0x7f07c00714d0 2023-06-23T18:50:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a8003530 con 0x7f07c00714d0 2023-06-23T18:50:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 37761684 0 0) 0x7f07a8003530 con 0x7f07c00714d0 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 >> v2:172.21.15.81:3300/0 conn(0x7f07c006b7a0 msgr2=0x7f07c00babb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 --2- 172.21.15.38:0/1288240873 >> v2:172.21.15.81:3300/0 conn(0x7f07c006b7a0 0x7f07c00babb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 >> v1:172.21.15.81:6789/0 conn(0x7f07c00a5920 legacy=0x7f07c0158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c014e260 con 0x7f07c00714d0 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f07b4001680 con 0x7f07c00714d0 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 >> v1:172.21.15.38:6789/0 conn(0x7f07c00714d0 legacy=0x7f07c014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 0x7f07a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a80047d0 0x7f07a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8005180 0x7f07a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b6100 con 0x7f07a8003980 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a800c090 con 0x7f07a80047d0 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a800c250 con 0x7f07a8005180 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 0x7f07a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bdd9b640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a80047d0 0x7f07a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 -- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8005180 msgr2=0x7f07a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8005180 0x7f07a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 -- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a80047d0 msgr2=0x7f07a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07a80047d0 0x7f07a8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07be59c640 1 -- 172.21.15.38:0/1288240873 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8003530 con 0x7f07a8003980 2023-06-23T18:50:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.412+0000 7f07bed9d640 1 -- 172.21.15.38:0/1288240873 reap_dead start 2023-06-23T18:50:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07be59c640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 0x7f07a8003d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009ae0 tx=0x7f07b001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5844239c63e633 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00a6430 con 0x7f07a8003980 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00a6590 con 0x7f07a8003980 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bd59a640 1 -- 172.21.15.38:0/1288240873 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00a6940 con 0x7f07a8003980 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 msgr2=0x7f07a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 0x7f07a8003d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009ae0 tx=0x7f07b001ca50 comp rx=0 tx=0).stop 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- 172.21.15.38:0/1288240873 shutdown_connections 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/1288240873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a8003980 0x7f07a8003d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- 172.21.15.38:0/1288240873 >> 172.21.15.38:0/1288240873 conn(0x7f07c00c0230 msgr2=0x7f07c00c0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- 172.21.15.38:0/1288240873 shutdown_connections 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- 172.21.15.38:0/1288240873 wait complete. 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 Processor -- start 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- start start 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8003980 0x7f07c0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0070870 0x7f07c01ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00bb0f0 con 0x7f07c014a260 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0149f40 con 0x7f07c0070870 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07c4e5d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0071250 con 0x7f07a8003980 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60570/0 (socket says 172.21.15.38:60570) 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 -- 172.21.15.38:0/2999530506 learned_addr learned my addr 172.21.15.38:0/2999530506 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07be59c640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8003980 0x7f07c0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bed9d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0070870 0x7f07c01ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 -- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8003980 msgr2=0x7f07c0070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8003980 0x7f07c0070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 -- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0070870 msgr2=0x7f07c01ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0070870 0x7f07c01ea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.416+0000 7f07bdd9b640 1 -- 172.21.15.38:0/2999530506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b8fd0 con 0x7f07c014a260 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07bdd9b640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007fd0 tx=0x7f07b400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40074e0 con 0x7f07c014a260 2023-06-23T18:50:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4007640 con 0x7f07c014a260 2023-06-23T18:50:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40049f0 con 0x7f07c014a260 2023-06-23T18:50:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00b8cf0 con 0x7f07c014a260 2023-06-23T18:50:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c01eab10 con 0x7f07c014a260 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c01ead90 con 0x7f07c014a260 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07b4004b50 con 0x7f07c014a260 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 0x7f07a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07b40839c0 con 0x7f07c014a260 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07be59c640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 0x7f07a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.420+0000 7f07be59c640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 0x7f07a0068760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07b00ad000 tx=0x7f07b00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.424+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07b4050b50 con 0x7f07c014a260 2023-06-23T18:50:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.612+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07c004d790 con 0x7f07c014a260 2023-06-23T18:50:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.612+0000 7f07aeffd640 1 -- 172.21.15.38:0/2999530506 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f07b4019070 con 0x7f07c014a260 2023-06-23T18:50:11.622 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-23T18:50:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 msgr2=0x7f07a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 0x7f07a0068760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07b00ad000 tx=0x7f07b00046d0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 msgr2=0x7f07c01ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007fd0 tx=0x7f07b400dc70 comp rx=0 tx=0).stop 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 shutdown_connections 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a00662b0 0x7f07a0068760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0070870 0x7f07c01ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c014a260 0x7f07c01ea090 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 --2- 172.21.15.38:0/2999530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07a8003980 0x7f07c0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 >> 172.21.15.38:0/2999530506 conn(0x7f07c00c0230 msgr2=0x7f07c0152160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 shutdown_connections 2023-06-23T18:50:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:11.616+0000 7f07c4e5d640 1 -- 172.21.15.38:0/2999530506 wait complete. 2023-06-23T18:50:11.641 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T18:50:11.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:50:11.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-06-23T18:50:11.641 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-23T18:50:11.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:11.642 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T18:50:11.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T18:50:11.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:50:11.642 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-23T18:50:11.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.643 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-06-23T18:50:11.649 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:50:11.649 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:11.650 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:11.651 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42361sec preferred_lft 42361sec 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 02:42:8a:d3:63:8d brd ff:ff:ff:ff:ff:ff 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-23T18:50:11.652 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:50:11.653 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T18:50:11.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.653 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-06-23T18:50:11.653 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-06-23T18:50:11.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-06-23T18:50:11.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-06-23T18:50:11.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-06-23T18:50:11.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T18:50:11.655 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-06-23T18:50:11.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.736 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:50:11.746 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-06-23T18:50:11.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.748 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-06-23T18:50:11.823 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:11.824 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:11.825 INFO:teuthology.orchestra.run.smithi192.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-23T18:50:11.825 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:50:11.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.825 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-06-23T18:50:11.826 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-06-23T18:50:11.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:50:11.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:50:11.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:50:11.827 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-06-23T18:50:11.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.902 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-06-23T18:50:11.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.948 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-06-23T18:50:11.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:11.996 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-06-23T18:50:11.996 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-06-23T18:50:11.996 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-23T18:50:11.996 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2023-06-23T18:50:11.997 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-06-23T18:50:12.064 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2023-06-23T18:50:12.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:12.065 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-06-23T18:50:12.065 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-06-23T18:50:12.065 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2023-06-23T18:50:12.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T18:50:12.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-23T18:50:12.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-23T18:50:12.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-23T18:50:12.066 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-06-23T18:50:12.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:12.170 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-06-23T18:50:12.170 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-06-23T18:50:12.170 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-06-23T18:50:12.170 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T18:50:12.171 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-06-23T18:50:12.191 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-06-23T18:50:12.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:12.192 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:12.242 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-23T18:50:12.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:50:12.243 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:12.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-06-23T18:50:12.342 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:12.342 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:12.394 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:12.395 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:12.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:12.396 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-06-23T18:50:12.443 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-23T18:50:12.443 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-06-23T18:50:12.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-06-23T18:50:12.505 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:12.506 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:12.561 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:12.562 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:12.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:12.563 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-06-23T18:50:12.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:2023-06-23T18:50:12.583+0000 7f81cd06c580 -1 init, newargv = 0x55c83b0c8ec0 newargc=15 2023-06-23T18:50:12.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:ceph-fuse[32772]: starting ceph client 2023-06-23T18:50:12.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:ceph-fuse[32772]: starting fuse 2023-06-23T18:50:13.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-06-23T18:50:13.712 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-23T18:50:13.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-23T18:50:13.767 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-23T18:50:13.768 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-23T18:50:13.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:13.769 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-06-23T18:50:13.815 INFO:teuthology.orchestra.run.smithi192.stdout:45 2023-06-23T18:50:13.816 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-23T18:50:13.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-23T18:50:13.817 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2023-06-23T18:50:13.817 DEBUG:teuthology.orchestra.run.smithi192:> import re 2023-06-23T18:50:13.818 DEBUG:teuthology.orchestra.run.smithi192:> import os 2023-06-23T18:50:13.818 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2023-06-23T18:50:13.819 DEBUG:teuthology.orchestra.run.smithi192:> 2023-06-23T18:50:13.819 DEBUG:teuthology.orchestra.run.smithi192:> def _find_admin_socket(client_name): 2023-06-23T18:50:13.819 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-06-23T18:50:13.819 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2023-06-23T18:50:13.820 DEBUG:teuthology.orchestra.run.smithi192:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-06-23T18:50:13.821 DEBUG:teuthology.orchestra.run.smithi192:> 2023-06-23T18:50:13.821 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2023-06-23T18:50:13.822 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2023-06-23T18:50:13.822 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2023-06-23T18:50:13.822 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2023-06-23T18:50:13.823 DEBUG:teuthology.orchestra.run.smithi192:> 2023-06-23T18:50:13.823 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2023-06-23T18:50:13.823 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-23T18:50:13.823 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-23T18:50:13.824 DEBUG:teuthology.orchestra.run.smithi192:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-23T18:50:13.824 DEBUG:teuthology.orchestra.run.smithi192:> contents = proc_f.read() 2023-06-23T18:50:13.825 DEBUG:teuthology.orchestra.run.smithi192:> if mountpoint in contents: 2023-06-23T18:50:13.825 DEBUG:teuthology.orchestra.run.smithi192:> return f 2023-06-23T18:50:13.826 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-23T18:50:13.826 DEBUG:teuthology.orchestra.run.smithi192:> 2023-06-23T18:50:13.826 DEBUG:teuthology.orchestra.run.smithi192:> print(_find_admin_socket("client.2")) 2023-06-23T18:50:13.826 DEBUG:teuthology.orchestra.run.smithi192:> ' 2023-06-23T18:50:13.935 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.2.32772.asok 2023-06-23T18:50:14.118 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.32772.asok 2023-06-23T18:50:14.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.118 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.32772.asok status 2023-06-23T18:50:14.270 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "8627af3e0adcb765a3c249fcc209cba9f4873e1b", 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev)", 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "2", 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2023-06-23T18:50:14.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "32772", 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4625, 2023-06-23T18:50:14.272 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 4625 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2023-06-23T18:50:14.273 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 611073043 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: } 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 611073043 2023-06-23T18:50:14.274 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.4625 172.21.15.192:0/611073043", 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "172.21.15.192:0/611073043", 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 8, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 28, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklisted": false, 2023-06-23T18:50:14.275 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2023-06-23T18:50:14.276 INFO:teuthology.orchestra.run.smithi192.stdout:} 2023-06-23T18:50:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.286 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-06-23T18:50:14.286 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:14.294 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-06-23T18:50:14.294 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:14.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:14.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.349 DEBUG:teuthology.orchestra.run.smithi164:> stat --file-system '--printf=%T 2023-06-23T18:50:14.349 DEBUG:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:14.356 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2023-06-23T18:50:14.357 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:14.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:14.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.415 DEBUG:teuthology.orchestra.run.smithi192:> stat --file-system '--printf=%T 2023-06-23T18:50:14.415 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:14.425 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2023-06-23T18:50:14.426 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:14.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:14.426 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:14.479 INFO:teuthology.run_tasks:Running task pexec... 2023-06-23T18:50:14.489 INFO:teuthology.task.pexec:Executing custom commands... 2023-06-23T18:50:14.490 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:50:14.490 DEBUG:teuthology.orchestra.run.smithi118:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-06-23T18:50:14.491 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi164.front.sepia.ceph.com 2023-06-23T18:50:14.491 DEBUG:teuthology.orchestra.run.smithi164:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-06-23T18:50:14.492 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T18:50:14.492 DEBUG:teuthology.orchestra.run.smithi192:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-06-23T18:50:14.566 INFO:teuthology.orchestra.run.smithi118.stderr:--2023-06-23 18:50:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-06-23T18:50:14.567 INFO:teuthology.orchestra.run.smithi118.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-06-23T18:50:14.572 INFO:teuthology.orchestra.run.smithi164.stderr:--2023-06-23 18:50:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-06-23T18:50:14.574 INFO:teuthology.orchestra.run.smithi164.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-06-23T18:50:14.588 INFO:teuthology.orchestra.run.smithi118.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-06-23T18:50:14.595 INFO:teuthology.orchestra.run.smithi192.stderr:--2023-06-23 18:50:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-06-23T18:50:14.597 INFO:teuthology.orchestra.run.smithi192.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-06-23T18:50:14.618 INFO:teuthology.orchestra.run.smithi164.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-06-23T18:50:14.618 INFO:teuthology.orchestra.run.smithi192.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-06-23T18:50:14.632 INFO:teuthology.orchestra.run.smithi118.stderr:HTTP request sent, awaiting response... 200 OK 2023-06-23T18:50:14.632 INFO:teuthology.orchestra.run.smithi118.stderr:Length: 36252 (35K) [application/octet-stream] 2023-06-23T18:50:14.632 INFO:teuthology.orchestra.run.smithi118.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-06-23T18:50:14.632 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-06-23T18:50:14.639 INFO:teuthology.orchestra.run.smithi192.stderr:HTTP request sent, awaiting response... 200 OK 2023-06-23T18:50:14.639 INFO:teuthology.orchestra.run.smithi192.stderr:Length: 36252 (35K) [application/octet-stream] 2023-06-23T18:50:14.639 INFO:teuthology.orchestra.run.smithi192.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-06-23T18:50:14.639 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-06-23T18:50:14.652 INFO:teuthology.orchestra.run.smithi118.stderr: 0K .......... .......... .......... ..... 100% 1.68M=0.02s 2023-06-23T18:50:14.652 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-06-23T18:50:14.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-06-23 18:50:14 (1.68 MB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-06-23T18:50:14.652 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-06-23T18:50:14.658 INFO:teuthology.orchestra.run.smithi118.stdout:COPYRIGHT 2023-06-23T18:50:14.659 INFO:teuthology.orchestra.run.smithi118.stdout:Makefile 2023-06-23T18:50:14.659 INFO:teuthology.orchestra.run.smithi118.stdout:README 2023-06-23T18:50:14.659 INFO:teuthology.orchestra.run.smithi118.stdout:RELEASE_LOG 2023-06-23T18:50:14.659 INFO:teuthology.orchestra.run.smithi118.stdout:mdtest.1 2023-06-23T18:50:14.660 INFO:teuthology.orchestra.run.smithi118.stdout:mdtest.c 2023-06-23T18:50:14.661 INFO:teuthology.orchestra.run.smithi192.stderr: 0K .......... .......... .......... ..... 100% 1.71M=0.02s 2023-06-23T18:50:14.661 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-06-23T18:50:14.661 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23 18:50:14 (1.71 MB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-06-23T18:50:14.661 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-06-23T18:50:14.661 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/ 2023-06-23T18:50:14.662 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/env_to_db.tcsh 2023-06-23T18:50:14.662 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/mdtest_wrapper.py 2023-06-23T18:50:14.662 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/paramCatch.py 2023-06-23T18:50:14.662 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/tester.py 2023-06-23T18:50:14.662 INFO:teuthology.orchestra.run.smithi118.stdout:scripts/WRAPPER_README 2023-06-23T18:50:14.664 INFO:teuthology.orchestra.run.smithi164.stderr:HTTP request sent, awaiting response... 200 OK 2023-06-23T18:50:14.665 INFO:teuthology.orchestra.run.smithi164.stderr:Length: 36252 (35K) [application/octet-stream] 2023-06-23T18:50:14.665 INFO:teuthology.orchestra.run.smithi164.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-06-23T18:50:14.665 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-06-23T18:50:14.666 INFO:teuthology.orchestra.run.smithi118.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-06-23T18:50:14.667 INFO:teuthology.orchestra.run.smithi192.stdout:COPYRIGHT 2023-06-23T18:50:14.668 INFO:teuthology.orchestra.run.smithi192.stdout:Makefile 2023-06-23T18:50:14.668 INFO:teuthology.orchestra.run.smithi192.stdout:README 2023-06-23T18:50:14.668 INFO:teuthology.orchestra.run.smithi192.stdout:RELEASE_LOG 2023-06-23T18:50:14.668 INFO:teuthology.orchestra.run.smithi192.stdout:mdtest.1 2023-06-23T18:50:14.669 INFO:teuthology.orchestra.run.smithi192.stdout:mdtest.c 2023-06-23T18:50:14.669 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/ 2023-06-23T18:50:14.669 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/env_to_db.tcsh 2023-06-23T18:50:14.669 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/mdtest_wrapper.py 2023-06-23T18:50:14.670 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/paramCatch.py 2023-06-23T18:50:14.670 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/tester.py 2023-06-23T18:50:14.670 INFO:teuthology.orchestra.run.smithi192.stdout:scripts/WRAPPER_README 2023-06-23T18:50:14.672 INFO:teuthology.orchestra.run.smithi192.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-06-23T18:50:14.710 INFO:teuthology.orchestra.run.smithi164.stderr: 0K .......... .......... .......... ..... 100% 770K=0.05s 2023-06-23T18:50:14.710 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-06-23T18:50:14.711 INFO:teuthology.orchestra.run.smithi164.stderr:2023-06-23 18:50:14 (770 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-06-23T18:50:14.711 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-06-23T18:50:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:COPYRIGHT 2023-06-23T18:50:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:Makefile 2023-06-23T18:50:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:README 2023-06-23T18:50:14.719 INFO:teuthology.orchestra.run.smithi164.stdout:RELEASE_LOG 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:mdtest.1 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:mdtest.c 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/ 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/env_to_db.tcsh 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/mdtest_wrapper.py 2023-06-23T18:50:14.720 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/paramCatch.py 2023-06-23T18:50:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/tester.py 2023-06-23T18:50:14.721 INFO:teuthology.orchestra.run.smithi164.stdout:scripts/WRAPPER_README 2023-06-23T18:50:14.723 INFO:teuthology.orchestra.run.smithi164.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-06-23T18:50:15.246 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.261 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.261 INFO:teuthology.orchestra.run.smithi118.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-06-23T18:50:15.261 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~^ ~~~~~~~~~~ 2023-06-23T18:50:15.262 INFO:teuthology.orchestra.run.smithi118.stderr: | | | 2023-06-23T18:50:15.262 INFO:teuthology.orchestra.run.smithi118.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.262 INFO:teuthology.orchestra.run.smithi118.stderr: | long long unsigned int 2023-06-23T18:50:15.262 INFO:teuthology.orchestra.run.smithi118.stderr: | %lu 2023-06-23T18:50:15.262 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~^ ~~~~~~~~~~~ 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: | | | 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: | long long unsigned int 2023-06-23T18:50:15.263 INFO:teuthology.orchestra.run.smithi118.stderr: | %lu 2023-06-23T18:50:15.285 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-06-23T18:50:15.285 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.286 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.287 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.288 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'collective_helper': 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.290 INFO:teuthology.orchestra.run.smithi118.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.291 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.291 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.291 INFO:teuthology.orchestra.run.smithi118.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.292 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.292 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.292 INFO:teuthology.orchestra.run.smithi118.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.292 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.292 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.293 INFO:teuthology.orchestra.run.smithi118.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.293 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.299 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'create_remove_items': 2023-06-23T18:50:15.299 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:893:42: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.299 INFO:teuthology.orchestra.run.smithi118.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.300 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~ 2023-06-23T18:50:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:893:25: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-06-23T18:50:15.301 INFO:teuthology.orchestra.run.smithi118.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.301 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.304 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'mdtest_stat': 2023-06-23T18:50:15.304 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.304 INFO:teuthology.orchestra.run.smithi118.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.304 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.305 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.305 INFO:teuthology.orchestra.run.smithi118.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.305 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.306 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~ 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.307 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~ 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.308 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr: | ^ 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.309 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'mdtest_read': 2023-06-23T18:50:15.310 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.310 INFO:teuthology.orchestra.run.smithi118.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.310 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.310 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.310 INFO:teuthology.orchestra.run.smithi118.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~ 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.311 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~ 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.312 INFO:teuthology.orchestra.run.smithi118.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr: | ^ 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'collective_create_remove': 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.313 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.314 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-06-23T18:50:15.314 INFO:teuthology.orchestra.run.smithi118.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.314 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.314 INFO:teuthology.orchestra.run.smithi118.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-06-23T18:50:15.315 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.315 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.315 INFO:teuthology.orchestra.run.smithi118.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.315 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.316 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.316 INFO:teuthology.orchestra.run.smithi118.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.316 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.316 INFO:teuthology.orchestra.run.smithi118.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-06-23T18:50:15.317 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.317 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.317 INFO:teuthology.orchestra.run.smithi118.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.317 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.318 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.318 INFO:teuthology.orchestra.run.smithi118.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.318 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.319 INFO:teuthology.orchestra.run.smithi118.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-06-23T18:50:15.319 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.319 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.320 INFO:teuthology.orchestra.run.smithi118.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.320 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.320 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.320 INFO:teuthology.orchestra.run.smithi118.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.321 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.321 INFO:teuthology.orchestra.run.smithi118.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-06-23T18:50:15.321 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.322 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.322 INFO:teuthology.orchestra.run.smithi118.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.322 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.322 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.323 INFO:teuthology.orchestra.run.smithi118.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.323 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.323 INFO:teuthology.orchestra.run.smithi118.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-06-23T18:50:15.323 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.323 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.324 INFO:teuthology.orchestra.run.smithi118.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.324 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.324 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.325 INFO:teuthology.orchestra.run.smithi118.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.325 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.325 INFO:teuthology.orchestra.run.smithi118.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-06-23T18:50:15.325 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.325 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-06-23T18:50:15.326 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-06-23T18:50:15.327 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-06-23T18:50:15.328 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-06-23T18:50:15.329 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.330 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.331 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.331 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.331 INFO:teuthology.orchestra.run.smithi192.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-06-23T18:50:15.331 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~^ ~~~~~~~~~~ 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: | | | 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: | long long unsigned int 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: | %lu 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-06-23T18:50:15.332 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~^ ~~~~~~~~~~~ 2023-06-23T18:50:15.333 INFO:teuthology.orchestra.run.smithi192.stderr: | | | 2023-06-23T18:50:15.333 INFO:teuthology.orchestra.run.smithi192.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.333 INFO:teuthology.orchestra.run.smithi192.stderr: | long long unsigned int 2023-06-23T18:50:15.333 INFO:teuthology.orchestra.run.smithi192.stderr: | %lu 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-06-23T18:50:15.335 INFO:teuthology.orchestra.run.smithi118.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr: | ^ 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.336 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-06-23T18:50:15.337 INFO:teuthology.orchestra.run.smithi118.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.338 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.339 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.340 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.341 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: 2849 | (rank+(0*nstride))%i); 2023-06-23T18:50:15.342 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: 2851 | (rank+(1*nstride))%i); 2023-06-23T18:50:15.343 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.344 INFO:teuthology.orchestra.run.smithi118.stderr: 2853 | (rank+(2*nstride))%i); 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.345 INFO:teuthology.orchestra.run.smithi118.stderr: 2855 | (rank+(3*nstride))%i); 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.346 INFO:teuthology.orchestra.run.smithi118.stderr: 2857 | (rank+(4*nstride))%i); 2023-06-23T18:50:15.347 INFO:teuthology.orchestra.run.smithi118.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.347 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.347 INFO:teuthology.orchestra.run.smithi164.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~^ ~~~~~~~~~~ 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: | | | 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: | long long unsigned int 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: | %lu 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-23T18:50:15.348 INFO:teuthology.orchestra.run.smithi164.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-06-23T18:50:15.349 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~^ ~~~~~~~~~~~ 2023-06-23T18:50:15.349 INFO:teuthology.orchestra.run.smithi164.stderr: | | | 2023-06-23T18:50:15.349 INFO:teuthology.orchestra.run.smithi164.stderr: | | size_t {aka long unsigned int} 2023-06-23T18:50:15.349 INFO:teuthology.orchestra.run.smithi164.stderr: | long long unsigned int 2023-06-23T18:50:15.349 INFO:teuthology.orchestra.run.smithi164.stderr: | %lu 2023-06-23T18:50:15.355 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-06-23T18:50:15.355 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.355 INFO:teuthology.orchestra.run.smithi192.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.355 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.355 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.356 INFO:teuthology.orchestra.run.smithi192.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.357 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.358 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.358 INFO:teuthology.orchestra.run.smithi192.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.358 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.358 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.359 INFO:teuthology.orchestra.run.smithi192.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'collective_helper': 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.360 INFO:teuthology.orchestra.run.smithi192.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.361 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.362 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.363 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.363 INFO:teuthology.orchestra.run.smithi192.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.363 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.369 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.370 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.371 INFO:teuthology.orchestra.run.smithi164.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.372 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'collective_helper': 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.373 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.374 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.375 INFO:teuthology.orchestra.run.smithi164.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~ 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'create_remove_items': 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:893:42: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.376 INFO:teuthology.orchestra.run.smithi164.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~ 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:893:25: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'mdtest_stat': 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.377 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-06-23T18:50:15.378 INFO:teuthology.orchestra.run.smithi164.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~ 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.379 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~ 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.380 INFO:teuthology.orchestra.run.smithi164.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr: | ^ 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'mdtest_read': 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.381 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~ 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.382 INFO:teuthology.orchestra.run.smithi164.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~ 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.383 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr: | ^ 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'collective_create_remove': 2023-06-23T18:50:15.384 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.385 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.386 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.387 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-06-23T18:50:15.388 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.389 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.389 INFO:teuthology.orchestra.run.smithi164.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.389 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.389 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.389 INFO:teuthology.orchestra.run.smithi164.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.390 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.391 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.392 INFO:teuthology.orchestra.run.smithi164.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.392 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.392 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.392 INFO:teuthology.orchestra.run.smithi164.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.393 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.394 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-06-23T18:50:15.395 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.396 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.396 INFO:teuthology.orchestra.run.smithi164.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.396 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.396 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.397 INFO:teuthology.orchestra.run.smithi164.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.397 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.397 INFO:teuthology.orchestra.run.smithi164.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-06-23T18:50:15.397 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'create_remove_items': 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:893:42: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~ 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:893:25: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-06-23T18:50:15.402 INFO:teuthology.orchestra.run.smithi192.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'mdtest_stat': 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.403 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~ 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.405 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~ 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.406 INFO:teuthology.orchestra.run.smithi192.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.407 INFO:teuthology.orchestra.run.smithi192.stderr: | ^ 2023-06-23T18:50:15.407 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.407 INFO:teuthology.orchestra.run.smithi192.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.407 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.407 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'mdtest_read': 2023-06-23T18:50:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-23T18:50:15.408 INFO:teuthology.orchestra.run.smithi192.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.408 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~ 2023-06-23T18:50:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-23T18:50:15.409 INFO:teuthology.orchestra.run.smithi192.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-23T18:50:15.409 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.409 INFO:teuthology.orchestra.run.smithi192.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~ 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~ 2023-06-23T18:50:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr: | ^ 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-23T18:50:15.411 INFO:teuthology.orchestra.run.smithi192.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'collective_create_remove': 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.412 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.413 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.414 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.415 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.415 INFO:teuthology.orchestra.run.smithi192.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.415 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.416 INFO:teuthology.orchestra.run.smithi192.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-06-23T18:50:15.416 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.416 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.416 INFO:teuthology.orchestra.run.smithi192.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.417 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.417 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.417 INFO:teuthology.orchestra.run.smithi192.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.418 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.418 INFO:teuthology.orchestra.run.smithi192.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-06-23T18:50:15.418 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.419 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.420 INFO:teuthology.orchestra.run.smithi192.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.421 INFO:teuthology.orchestra.run.smithi192.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.422 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.422 INFO:teuthology.orchestra.run.smithi192.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.423 INFO:teuthology.orchestra.run.smithi192.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.424 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.424 INFO:teuthology.orchestra.run.smithi192.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-06-23T18:50:15.424 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.424 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.424 INFO:teuthology.orchestra.run.smithi192.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.425 INFO:teuthology.orchestra.run.smithi192.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-06-23T18:50:15.426 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.427 INFO:teuthology.orchestra.run.smithi192.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr: | ^ 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.428 INFO:teuthology.orchestra.run.smithi192.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.429 INFO:teuthology.orchestra.run.smithi192.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.430 INFO:teuthology.orchestra.run.smithi192.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.431 INFO:teuthology.orchestra.run.smithi192.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.432 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.433 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.434 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr: 2849 | (rank+(0*nstride))%i); 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.435 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.436 INFO:teuthology.orchestra.run.smithi192.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.436 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.436 INFO:teuthology.orchestra.run.smithi192.stderr: 2851 | (rank+(1*nstride))%i); 2023-06-23T18:50:15.436 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: 2853 | (rank+(2*nstride))%i); 2023-06-23T18:50:15.437 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: 2855 | (rank+(3*nstride))%i); 2023-06-23T18:50:15.438 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.439 INFO:teuthology.orchestra.run.smithi192.stderr: 2857 | (rank+(4*nstride))%i); 2023-06-23T18:50:15.440 INFO:teuthology.orchestra.run.smithi192.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.441 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-06-23T18:50:15.441 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.442 INFO:teuthology.orchestra.run.smithi164.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.443 INFO:teuthology.orchestra.run.smithi164.stderr: | ^ 2023-06-23T18:50:15.443 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-06-23T18:50:15.443 INFO:teuthology.orchestra.run.smithi164.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-23T18:50:15.443 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.443 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c: In function 'main': 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-23T18:50:15.444 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.445 INFO:teuthology.orchestra.run.smithi164.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.446 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.447 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.448 INFO:teuthology.orchestra.run.smithi164.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr: 2849 | (rank+(0*nstride))%i); 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.449 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: 2851 | (rank+(1*nstride))%i); 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.450 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: 2853 | (rank+(2*nstride))%i); 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.451 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: 2855 | (rank+(3*nstride))%i); 2023-06-23T18:50:15.452 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~ 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:15.453 INFO:teuthology.orchestra.run.smithi164.stderr: 2857 | (rank+(4*nstride))%i); 2023-06-23T18:50:15.454 INFO:teuthology.orchestra.run.smithi164.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-23T18:50:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-06-23T18:50:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-06-23T18:50:17.206 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-06-23T18:50:17.207 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-06-23T18:50:17.211 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-06-23T18:50:17.212 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.213 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.214 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.215 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.216 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.217 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.218 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-06-23T18:50:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.219 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.220 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.221 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-06-23T18:50:17.222 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-06-23T18:50:17.223 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.224 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-06-23T18:50:17.225 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-06-23T18:50:17.229 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.230 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-06-23T18:50:17.231 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x841): undefined reference to `fi_version' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.232 INFO:teuthology.orchestra.run.smithi164.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.311 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-06-23T18:50:17.311 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-06-23T18:50:17.311 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-06-23T18:50:17.311 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-06-23T18:50:17.312 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.312 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-06-23T18:50:17.312 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.312 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-06-23T18:50:17.312 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.317 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-06-23T18:50:17.317 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.317 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.317 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-06-23T18:50:17.317 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-06-23T18:50:17.318 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.319 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.320 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.321 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.322 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-06-23T18:50:17.324 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.324 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-06-23T18:50:17.324 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.324 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-06-23T18:50:17.324 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-06-23T18:50:17.325 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-06-23T18:50:17.326 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.327 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-06-23T18:50:17.327 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-06-23T18:50:17.327 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.328 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-06-23T18:50:17.328 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-06-23T18:50:17.332 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.333 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-06-23T18:50:17.334 INFO:teuthology.orchestra.run.smithi164.stderr:collect2: error: ld returned 1 exit status 2023-06-23T18:50:17.334 INFO:teuthology.orchestra.run.smithi164.stderr:make: *** [Makefile:59: mdtest] Error 1 2023-06-23T18:50:17.334 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-06-23T18:50:17.397 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d378183392b44f99b58acff818a3b6f8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-06-23T18:50:17.400 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-06-23T18:50:17.410 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-06-23T18:50:17.410 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:50:17.411 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:17.491 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-06-23T18:50:17.492 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-06-23T18:50:17.492 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.493 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.493 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.493 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-06-23T18:50:17.493 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.493 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.494 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.494 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.494 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.494 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-06-23T18:50:17.494 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-06-23T18:50:17.495 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.495 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.495 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-06-23T18:50:17.495 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-06-23T18:50:17.495 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.496 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-06-23T18:50:17.496 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-06-23T18:50:17.496 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.496 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-06-23T18:50:17.496 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x841): undefined reference to `fi_version' 2023-06-23T18:50:17.497 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-06-23T18:50:17.497 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-06-23T18:50:17.497 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.497 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.498 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-06-23T18:50:17.498 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-06-23T18:50:17.498 INFO:teuthology.orchestra.run.smithi192.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.498 INFO:teuthology.orchestra.run.smithi192.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.498 INFO:teuthology.orchestra.run.smithi192.stderr:collect2: error: ld returned 1 exit status 2023-06-23T18:50:17.499 INFO:teuthology.orchestra.run.smithi192.stderr:make: *** [Makefile:59: mdtest] Error 1 2023-06-23T18:50:17.508 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-06-23T18:50:17.508 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-06-23T18:50:17.509 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-06-23T18:50:17.509 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-06-23T18:50:17.509 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.509 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-06-23T18:50:17.509 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.510 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-06-23T18:50:17.510 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.510 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-06-23T18:50:17.510 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.510 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.511 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-06-23T18:50:17.511 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.511 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-06-23T18:50:17.511 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-06-23T18:50:17.511 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-06-23T18:50:17.512 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-06-23T18:50:17.512 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-06-23T18:50:17.512 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-06-23T18:50:17.512 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.512 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-06-23T18:50:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.513 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.514 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.515 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-06-23T18:50:17.515 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.515 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-06-23T18:50:17.515 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.515 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-06-23T18:50:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.516 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-06-23T18:50:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.517 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-06-23T18:50:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-06-23T18:50:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-06-23T18:50:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-06-23T18:50:17.518 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-06-23T18:50:17.519 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-06-23T18:50:17.520 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-06-23T18:50:17.520 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.520 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-06-23T18:50:17.520 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-06-23T18:50:17.520 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.521 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.521 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-06-23T18:50:17.521 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.521 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-06-23T18:50:17.521 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-23T18:50:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-06-23T18:50:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-06-23T18:50:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.522 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-06-23T18:50:17.523 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.523 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-06-23T18:50:17.523 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-06-23T18:50:17.523 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.523 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-06-23T18:50:17.524 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-06-23T18:50:17.524 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-06-23T18:50:17.524 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-06-23T18:50:17.524 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.524 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.525 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-06-23T18:50:17.526 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.526 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.526 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.527 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.527 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-06-23T18:50:17.527 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-06-23T18:50:17.527 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-06-23T18:50:17.528 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.528 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.528 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-06-23T18:50:17.528 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-06-23T18:50:17.528 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-06-23T18:50:17.529 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-06-23T18:50:17.529 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-06-23T18:50:17.529 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.529 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-06-23T18:50:17.529 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.530 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-06-23T18:50:17.530 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.530 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.530 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.530 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-06-23T18:50:17.531 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.531 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.531 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.531 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.531 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.532 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-06-23T18:50:17.532 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-06-23T18:50:17.532 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.532 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-06-23T18:50:17.532 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-06-23T18:50:17.533 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-06-23T18:50:17.534 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x841): undefined reference to `fi_version' 2023-06-23T18:50:17.534 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-06-23T18:50:17.534 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-06-23T18:50:17.534 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-06-23T18:50:17.534 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-06-23T18:50:17.535 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-06-23T18:50:17.535 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-06-23T18:50:17.535 INFO:teuthology.orchestra.run.smithi118.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-06-23T18:50:17.535 INFO:teuthology.orchestra.run.smithi118.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-06-23T18:50:17.537 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:50:17.537 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:17.581 INFO:teuthology.orchestra.run.smithi118.stderr:collect2: error: ld returned 1 exit status 2023-06-23T18:50:17.583 INFO:teuthology.orchestra.run.smithi118.stderr:make: *** [Makefile:59: mdtest] Error 1 2023-06-23T18:50:17.583 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-06-23T18:50:17.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:17.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.708+0000 7f08725e0640 1 Processor -- start 2023-06-23T18:50:17.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.708+0000 7f08725e0640 1 -- start start 2023-06-23T18:50:17.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f08725e0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f086c14b930 0x7f086c06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f08725e0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 0x7f086c070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f08725e0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0ba9d0 con 0x7f086c0bd1e0 2023-06-23T18:50:17.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f08725e0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0bc300 con 0x7f086c14b930 2023-06-23T18:50:17.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f08725e0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0a5570 con 0x7f086c06c9b0 2023-06-23T18:50:17.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f086c14b930 0x7f086c06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f086c0bd1e0 0x7f086c070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55364/0 (socket says 172.21.15.38:55364) 2023-06-23T18:50:17.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086b7fe640 1 -- 172.21.15.38:0/2593108664 learned_addr learned my addr 172.21.15.38:0/2593108664 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:17.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f0870b7d640 1 --2- 172.21.15.38:0/2593108664 >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 0x7f086c070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 -- 172.21.15.38:0/2593108664 >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 msgr2=0x7f086c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:17.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 --2- 172.21.15.38:0/2593108664 >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 0x7f086c070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 -- 172.21.15.38:0/2593108664 >> v1:172.21.15.38:6789/0 conn(0x7f086c0bd1e0 legacy=0x7f086c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 -- 172.21.15.38:0/2593108664 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c150160 con 0x7f086c14b930 2023-06-23T18:50:17.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f0870b7d640 1 --2- 172.21.15.38:0/2593108664 >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 0x7f086c070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:17.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086bfff640 1 --2- 172.21.15.38:0/2593108664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c14b930 0x7f086c06c470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f086c0b5060 tx=0x7f085401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a024f1813257773 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:17.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086affd640 1 -- 172.21.15.38:0/2593108664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540ab5f0 con 0x7f086c14b930 2023-06-23T18:50:17.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086affd640 1 -- 172.21.15.38:0/2593108664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08540ab750 con 0x7f086c14b930 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.712+0000 7f086affd640 1 -- 172.21.15.38:0/2593108664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540abae0 con 0x7f086c14b930 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2593108664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c14b930 msgr2=0x7f086c06c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- 172.21.15.38:0/2593108664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c14b930 0x7f086c06c470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f086c0b5060 tx=0x7f085401c3d0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2593108664 shutdown_connections 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- 172.21.15.38:0/2593108664 >> v2:172.21.15.81:3300/0 conn(0x7f086c06c9b0 0x7f086c070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- 172.21.15.38:0/2593108664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c14b930 0x7f086c06c470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2593108664 >> 172.21.15.38:0/2593108664 conn(0x7f086c0c0c90 msgr2=0x7f086c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:17.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2593108664 shutdown_connections 2023-06-23T18:50:17.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2593108664 wait complete. 2023-06-23T18:50:17.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 Processor -- start 2023-06-23T18:50:17.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- start start 2023-06-23T18:50:17.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f086c06c9b0 0x7f086c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 0x7f086c145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c06fd70 con 0x7f086c0bd1e0 2023-06-23T18:50:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1ea080 con 0x7f086c14b930 2023-06-23T18:50:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c148410 con 0x7f086c06c9b0 2023-06-23T18:50:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54994/0 (socket says 172.21.15.38:54994) 2023-06-23T18:50:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 -- 172.21.15.38:0/2179309854 learned_addr learned my addr 172.21.15.38:0/2179309854 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086bfff640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f086c06c9b0 0x7f086c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f0870b7d640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 0x7f086c145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 -- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f086c06c9b0 msgr2=0x7f086c1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f086c06c9b0 0x7f086c1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 -- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 msgr2=0x7f086c145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 0x7f086c145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 -- 172.21.15.38:0/2179309854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854009420 con 0x7f086c0bd1e0 2023-06-23T18:50:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f0870b7d640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 0x7f086c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f086b7fe640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c500 tx=0x7f085c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c005cf0 con 0x7f086c0bd1e0 2023-06-23T18:50:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c005e50 con 0x7f086c0bd1e0 2023-06-23T18:50:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c1ea2d0 con 0x7f086c0bd1e0 2023-06-23T18:50:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0072f0 con 0x7f086c0bd1e0 2023-06-23T18:50:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.716+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c149db0 con 0x7f086c0bd1e0 2023-06-23T18:50:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c04d790 con 0x7f086c0bd1e0 2023-06-23T18:50:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f085c007450 con 0x7f086c0bd1e0 2023-06-23T18:50:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f0868ff9640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f085c083480 con 0x7f086c0bd1e0 2023-06-23T18:50:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f086bfff640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.720+0000 7f086bfff640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 0x7f084c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08540af000 tx=0x7f08540a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.724+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f085c050750 con 0x7f086c0bd1e0 2023-06-23T18:50:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.876+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f086c066f10 con 0x7f086c0bd1e0 2023-06-23T18:50:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.880+0000 7f0868ff9640 1 -- 172.21.15.38:0/2179309854 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f085c053d70 con 0x7f086c0bd1e0 2023-06-23T18:50:17.889 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:17.889 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.880+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 msgr2=0x7f084c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 0x7f084c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08540af000 tx=0x7f08540a7000 comp rx=0 tx=0).stop 2023-06-23T18:50:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 msgr2=0x7f086c143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c500 tx=0x7f085c00c9c0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 shutdown_connections 2023-06-23T18:50:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f086c14b930 0x7f086c145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086c0bd1e0 0x7f086c143690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 --2- 172.21.15.38:0/2179309854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f086c06c9b0 0x7f086c1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 >> 172.21.15.38:0/2179309854 conn(0x7f086c0c0c90 msgr2=0x7f086c070260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 shutdown_connections 2023-06-23T18:50:17.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:17.884+0000 7f08725e0640 1 -- 172.21.15.38:0/2179309854 wait complete. 2023-06-23T18:50:17.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:17.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:18.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.032+0000 7fd19ad26640 1 Processor -- start 2023-06-23T18:50:18.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.032+0000 7fd19ad26640 1 -- start start 2023-06-23T18:50:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd19ad26640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1940c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd19ad26640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd194070270 con 0x7fd19406c4b0 2023-06-23T18:50:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd19ad26640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19414ff20 con 0x7fd1940ba7f0 2023-06-23T18:50:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd19ad26640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941504e0 con 0x7fd194149980 2023-06-23T18:50:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd198ac2640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd19406c4b0 0x7fd194149270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55368/0 (socket says 172.21.15.38:55368) 2023-06-23T18:50:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd198ac2640 1 -- 172.21.15.38:0/1191213713 learned_addr learned my addr 172.21.15.38:0/1191213713 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd193fff640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1940c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438084170 0 0) 0x7fd194070270 con 0x7fd19406c4b0 2023-06-23T18:50:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003530 con 0x7fd19406c4b0 2023-06-23T18:50:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653437780 0 0) 0x7fd180003530 con 0x7fd19406c4b0 2023-06-23T18:50:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 msgr2=0x7fd1940c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1940c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 >> v1:172.21.15.81:6789/0 conn(0x7fd1940ba7f0 legacy=0x7fd194070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194150200 con 0x7fd19406c4b0 2023-06-23T18:50:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fd184001680 con 0x7fd19406c4b0 2023-06-23T18:50:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 >> v1:172.21.15.38:6789/0 conn(0x7fd19406c4b0 legacy=0x7fd194149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd180003f30 0x7fd1800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd180004d10 0x7fd180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941504e0 con 0x7fd180004d10 2023-06-23T18:50:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000ba70 con 0x7fd180003f30 2023-06-23T18:50:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000bc30 con 0x7fd194149980 2023-06-23T18:50:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd180004d10 0x7fd180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd193fff640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd180003f30 0x7fd1800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd198ac2640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 -- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 msgr2=0x7fd1800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 -- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd180003f30 msgr2=0x7fd1800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd180003f30 0x7fd1800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd1992c3640 1 -- 172.21.15.38:0/1191213713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180003530 con 0x7fd180004d10 2023-06-23T18:50:18.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.036+0000 7fd198ac2640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd194149980 0x7fd1800039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:18.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd180004d10 0x7fd180005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd18c001e40 tx=0x7fd18c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155ba45711965db5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c003b80 con 0x7fd180004d10 2023-06-23T18:50:18.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c003ce0 con 0x7fd180004d10 2023-06-23T18:50:18.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1937fe640 1 -- 172.21.15.38:0/1191213713 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0052c0 con 0x7fd180004d10 2023-06-23T18:50:18.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/1191213713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd180004d10 msgr2=0x7fd180005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 --2- 172.21.15.38:0/1191213713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd180004d10 0x7fd180005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd18c001e40 tx=0x7fd18c01c740 comp rx=0 tx=0).stop 2023-06-23T18:50:18.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 -- 172.21.15.38:0/1191213713 reap_dead start 2023-06-23T18:50:18.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/1191213713 shutdown_connections 2023-06-23T18:50:18.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/1191213713 >> 172.21.15.38:0/1191213713 conn(0x7fd1940bfe30 msgr2=0x7fd1940c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/1191213713 shutdown_connections 2023-06-23T18:50:18.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/1191213713 wait complete. 2023-06-23T18:50:18.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 Processor -- start 2023-06-23T18:50:18.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- start start 2023-06-23T18:50:18.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 0x7fd194098a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd1941e2780 0x7fd1940b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194098f80 con 0x7fd1940b7120 2023-06-23T18:50:18.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194099230 con 0x7fd1940b8ae0 2023-06-23T18:50:18.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194099510 con 0x7fd1941e2780 2023-06-23T18:50:18.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55018/0 (socket says 172.21.15.38:55018) 2023-06-23T18:50:18.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 -- 172.21.15.38:0/4039148109 learned_addr learned my addr 172.21.15.38:0/4039148109 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:18.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd193fff640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd1941e2780 0x7fd1940b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd198ac2640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 0x7fd194098a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 -- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd1941e2780 msgr2=0x7fd1940b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd1941e2780 0x7fd1940b8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 -- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 msgr2=0x7fd194098a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 0x7fd194098a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 -- 172.21.15.38:0/4039148109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940b93f0 con 0x7fd1940b7120 2023-06-23T18:50:18.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd198ac2640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 0x7fd194098a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:18.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1992c3640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd18c01c780 tx=0x7fd180005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c007dc0 con 0x7fd1940b7120 2023-06-23T18:50:18.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c0b5030 con 0x7fd1940b7120 2023-06-23T18:50:18.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194098f80 con 0x7fd1940b7120 2023-06-23T18:50:18.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c005230 con 0x7fd1940b7120 2023-06-23T18:50:18.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.040+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1940b7ca0 con 0x7fd1940b7120 2023-06-23T18:50:18.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19404d790 con 0x7fd1940b7120 2023-06-23T18:50:18.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd18c005390 con 0x7fd1940b7120 2023-06-23T18:50:18.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd1917fa640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 0x7fd174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd18c11d810 con 0x7fd1940b7120 2023-06-23T18:50:18.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd198ac2640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 0x7fd174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.044+0000 7fd198ac2640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 0x7fd174068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd184001210 tx=0x7fd184009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.048+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd18c0ea900 con 0x7fd1940b7120 2023-06-23T18:50:18.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.200+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1940b7ca0 con 0x7fd1940b7120 2023-06-23T18:50:18.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd1917fa640 1 -- 172.21.15.38:0/4039148109 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1940b7ca0 con 0x7fd1940b7120 2023-06-23T18:50:18.211 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:18.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 msgr2=0x7fd174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 0x7fd174068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd184001210 tx=0x7fd184009040 comp rx=0 tx=0).stop 2023-06-23T18:50:18.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 msgr2=0x7fd1940b7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd18c01c780 tx=0x7fd180005800 comp rx=0 tx=0).stop 2023-06-23T18:50:18.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 shutdown_connections 2023-06-23T18:50:18.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd174066280 0x7fd174068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1940b7120 0x7fd1940b7590 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd1941e2780 0x7fd1940b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 --2- 172.21.15.38:0/4039148109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940b8ae0 0x7fd194098a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 >> 172.21.15.38:0/4039148109 conn(0x7fd1940bfe30 msgr2=0x7fd1940bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 shutdown_connections 2023-06-23T18:50:18.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.204+0000 7fd19ad26640 1 -- 172.21.15.38:0/4039148109 wait complete. 2023-06-23T18:50:18.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:18.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 Processor -- start 2023-06-23T18:50:18.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 -- start start 2023-06-23T18:50:18.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb6400beaf0 0x7fb640152f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6401538f0 con 0x7fb640153490 2023-06-23T18:50:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6400c22c0 con 0x7fb6400c2e80 2023-06-23T18:50:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb644989640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400c03e0 con 0x7fb6400beaf0 2023-06-23T18:50:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb640153490 0x7fb640156320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55382/0 (socket says 172.21.15.38:55382) 2023-06-23T18:50:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63ed9d640 1 -- 172.21.15.38:0/2882257897 learned_addr learned my addr 172.21.15.38:0/2882257897 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63e59c640 1 --2- 172.21.15.38:0/2882257897 >> v2:172.21.15.38:3300/0 conn(0x7fb6400beaf0 0x7fb640152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63d59a640 1 -- 172.21.15.38:0/2882257897 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579210422 0 0) 0x7fb6401538f0 con 0x7fb640153490 2023-06-23T18:50:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63d59a640 1 -- 172.21.15.38:0/2882257897 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb628003530 con 0x7fb640153490 2023-06-23T18:50:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63e59c640 1 -- 172.21.15.38:0/2882257897 >> v1:172.21.15.81:6789/0 conn(0x7fb6400c2e80 legacy=0x7fb640155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63e59c640 1 -- 172.21.15.38:0/2882257897 >> v1:172.21.15.38:6789/0 conn(0x7fb640153490 legacy=0x7fb640156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.352+0000 7fb63e59c640 1 -- 172.21.15.38:0/2882257897 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400c25a0 con 0x7fb6400beaf0 2023-06-23T18:50:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63e59c640 1 --2- 172.21.15.38:0/2882257897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400beaf0 0x7fb640152f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb6300097c0 tx=0x7fb63001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab24af2b3e4c2c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63d59a640 1 -- 172.21.15.38:0/2882257897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300ab600 con 0x7fb6400beaf0 2023-06-23T18:50:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63d59a640 1 -- 172.21.15.38:0/2882257897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6300a7050 con 0x7fb6400beaf0 2023-06-23T18:50:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63d59a640 1 -- 172.21.15.38:0/2882257897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300ab960 con 0x7fb6400beaf0 2023-06-23T18:50:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- 172.21.15.38:0/2882257897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400beaf0 msgr2=0x7fb640152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 --2- 172.21.15.38:0/2882257897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400beaf0 0x7fb640152f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb6300097c0 tx=0x7fb63001c3b0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- 172.21.15.38:0/2882257897 shutdown_connections 2023-06-23T18:50:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 --2- 172.21.15.38:0/2882257897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400beaf0 0x7fb640152f50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- 172.21.15.38:0/2882257897 >> 172.21.15.38:0/2882257897 conn(0x7fb6400a5d50 msgr2=0x7fb6400a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- 172.21.15.38:0/2882257897 shutdown_connections 2023-06-23T18:50:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- 172.21.15.38:0/2882257897 wait complete. 2023-06-23T18:50:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 Processor -- start 2023-06-23T18:50:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- start start 2023-06-23T18:50:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400beaf0 0x7fb6400ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 0x7fb6400b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401546c0 con 0x7fb6400c2e80 2023-06-23T18:50:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400bab10 con 0x7fb6400beaf0 2023-06-23T18:50:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb644989640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400c4e10 con 0x7fb640153490 2023-06-23T18:50:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55044/0 (socket says 172.21.15.38:55044) 2023-06-23T18:50:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 -- 172.21.15.38:0/3484564186 learned_addr learned my addr 172.21.15.38:0/3484564186 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63e59c640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400beaf0 0x7fb6400ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63ed9d640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 0x7fb6400b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 -- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 msgr2=0x7fb6400b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 0x7fb6400b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 -- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400beaf0 msgr2=0x7fb6400ba5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400beaf0 0x7fb6400ba5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63dd9b640 1 -- 172.21.15.38:0/3484564186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009420 con 0x7fb6400c2e80 2023-06-23T18:50:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.356+0000 7fb63ed9d640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 0x7fb6400b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb63dd9b640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c450 tx=0x7fb63400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634012830 con 0x7fb6400c2e80 2023-06-23T18:50:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340129b0 con 0x7fb6400c2e80 2023-06-23T18:50:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400c4b30 con 0x7fb6400c2e80 2023-06-23T18:50:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634012d60 con 0x7fb6400c2e80 2023-06-23T18:50:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400c48e0 con 0x7fb6400c2e80 2023-06-23T18:50:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64004d790 con 0x7fb6400c2e80 2023-06-23T18:50:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb63401c460 con 0x7fb6400c2e80 2023-06-23T18:50:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 0x7fb620068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb634083ec0 con 0x7fb6400c2e80 2023-06-23T18:50:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb63e59c640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 0x7fb620068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.360+0000 7fb63e59c640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 0x7fb620068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb6300ad000 tx=0x7fb6300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.364+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb634051050 con 0x7fb6400c2e80 2023-06-23T18:50:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.516+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6400aa1c0 con 0x7fb6400c2e80 2023-06-23T18:50:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb62effd640 1 -- 172.21.15.38:0/3484564186 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb634054670 con 0x7fb6400c2e80 2023-06-23T18:50:18.529 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:18.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 msgr2=0x7fb620068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 0x7fb620068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb6300ad000 tx=0x7fb6300a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:18.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 msgr2=0x7fb6400c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c450 tx=0x7fb63400c910 comp rx=0 tx=0).stop 2023-06-23T18:50:18.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 shutdown_connections 2023-06-23T18:50:18.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb620066280 0x7fb620068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb640153490 0x7fb6400b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6400c2e80 0x7fb6400c41d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 --2- 172.21.15.38:0/3484564186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400beaf0 0x7fb6400ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 >> 172.21.15.38:0/3484564186 conn(0x7fb6400a5d50 msgr2=0x7fb6400a3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 shutdown_connections 2023-06-23T18:50:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.520+0000 7fb644989640 1 -- 172.21.15.38:0/3484564186 wait complete. 2023-06-23T18:50:18.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:18.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.664+0000 7f3e71d4e640 1 Processor -- start 2023-06-23T18:50:18.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.664+0000 7f3e71d4e640 1 -- start start 2023-06-23T18:50:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e71d4e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e6c0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e71d4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e6c0ba7f0 0x7f3e6c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e71d4e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c070270 con 0x7f3e6c149270 2023-06-23T18:50:18.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e71d4e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c1504e0 con 0x7f3e6c0ba7f0 2023-06-23T18:50:18.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e71d4e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c14ff20 con 0x7f3e6c06c4b0 2023-06-23T18:50:18.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3e6c149270 0x7f3e6c1496f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55394/0 (socket says 172.21.15.38:55394) 2023-06-23T18:50:18.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6bfff640 1 -- 172.21.15.38:0/1481314173 learned_addr learned my addr 172.21.15.38:0/1481314173 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:18.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 --2- 172.21.15.38:0/1481314173 >> v2:172.21.15.81:3300/0 conn(0x7f3e6c0ba7f0 0x7f3e6c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6b7fe640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e6c0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714074609 0 0) 0x7f3e6c070270 con 0x7f3e6c149270 2023-06-23T18:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e58003530 con 0x7f3e6c149270 2023-06-23T18:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280775491 0 0) 0x7f3e58003530 con 0x7f3e6c149270 2023-06-23T18:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 msgr2=0x7f3e6c0c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e6c0c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 >> v2:172.21.15.81:3300/0 conn(0x7f3e6c0ba7f0 msgr2=0x7f3e6c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 --2- 172.21.15.38:0/1481314173 >> v2:172.21.15.81:3300/0 conn(0x7f3e6c0ba7f0 0x7f3e6c14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c150200 con 0x7f3e6c149270 2023-06-23T18:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f3e64001a00 con 0x7f3e6c149270 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 >> v1:172.21.15.38:6789/0 conn(0x7f3e6c149270 legacy=0x7f3e6c1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e58003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e58003f00 0x7f3e580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e58004d10 0x7f3e58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c1504e0 con 0x7f3e58003f00 2023-06-23T18:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c14ff20 con 0x7f3e58004d10 2023-06-23T18:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5800b9c0 con 0x7f3e6c06c4b0 2023-06-23T18:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e58003f00 0x7f3e580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6b7fe640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e58003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 -- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 msgr2=0x7f3e58003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c06c4b0 0x7f3e58003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6bfff640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e58004d10 0x7f3e58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 -- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e58004d10 msgr2=0x7f3e58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e58004d10 0x7f3e58005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 -- 172.21.15.38:0/1481314173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58003530 con 0x7f3e58003f00 2023-06-23T18:50:18.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6affd640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e58003f00 0x7f3e580047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ae0 tx=0x7f3e5c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d69634d6e48c351 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0a6470 con 0x7f3e58003f00 2023-06-23T18:50:18.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.668+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0a65d0 con 0x7f3e58003f00 2023-06-23T18:50:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6a7fc640 1 -- 172.21.15.38:0/1481314173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0a6980 con 0x7f3e58003f00 2023-06-23T18:50:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/1481314173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e58003f00 msgr2=0x7f3e580047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/1481314173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e58003f00 0x7f3e580047d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ae0 tx=0x7f3e5c01ca30 comp rx=0 tx=0).stop 2023-06-23T18:50:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 -- 172.21.15.38:0/1481314173 reap_dead start 2023-06-23T18:50:18.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/1481314173 shutdown_connections 2023-06-23T18:50:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/1481314173 >> 172.21.15.38:0/1481314173 conn(0x7f3e6c0bfe30 msgr2=0x7f3e6c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/1481314173 shutdown_connections 2023-06-23T18:50:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/1481314173 wait complete. 2023-06-23T18:50:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 Processor -- start 2023-06-23T18:50:18.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- start start 2023-06-23T18:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c154ad0 0x7f3e6c154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6c14f0e0 0x7f3e6c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c06f610 con 0x7f3e6c14fa70 2023-06-23T18:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c154100 con 0x7f3e6c14f0e0 2023-06-23T18:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c06f050 con 0x7f3e6c154ad0 2023-06-23T18:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55068/0 (socket says 172.21.15.38:55068) 2023-06-23T18:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 -- 172.21.15.38:0/919342597 learned_addr learned my addr 172.21.15.38:0/919342597 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6b7fe640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c154ad0 0x7f3e6c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6affd640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6c14f0e0 0x7f3e6c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 -- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c154ad0 msgr2=0x7f3e6c154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c154ad0 0x7f3e6c154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 -- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6c14f0e0 msgr2=0x7f3e6c14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6c14f0e0 0x7f3e6c14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 -- 172.21.15.38:0/919342597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c06f330 con 0x7f3e6c14fa70 2023-06-23T18:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e6bfff640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e64001340 tx=0x7f3e64001f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640074e0 con 0x7f3e6c14fa70 2023-06-23T18:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64007640 con 0x7f3e6c14fa70 2023-06-23T18:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640079f0 con 0x7f3e6c14fa70 2023-06-23T18:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c06fd80 con 0x7f3e6c14fa70 2023-06-23T18:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.672+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c0b64c0 con 0x7f3e6c14fa70 2023-06-23T18:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c14ee00 con 0x7f3e6c14fa70 2023-06-23T18:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e6401d450 con 0x7f3e6c14fa70 2023-06-23T18:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e63fff640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 0x7f3e4c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e64083c60 con 0x7f3e6c14fa70 2023-06-23T18:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e6b7fe640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 0x7f3e4c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.676+0000 7f3e6b7fe640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 0x7f3e4c0687b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009a00 tx=0x7f3e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.680+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e6c14ee00 con 0x7f3e6c14fa70 2023-06-23T18:50:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e6c14ee00 con 0x7f3e6c14fa70 2023-06-23T18:50:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e63fff640 1 -- 172.21.15.38:0/919342597 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e6c14ee00 con 0x7f3e6c14fa70 2023-06-23T18:50:18.840 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 msgr2=0x7f3e4c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 0x7f3e4c0687b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009a00 tx=0x7f3e54008040 comp rx=0 tx=0).stop 2023-06-23T18:50:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 msgr2=0x7f3e6c143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e64001340 tx=0x7f3e64001f50 comp rx=0 tx=0).stop 2023-06-23T18:50:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 shutdown_connections 2023-06-23T18:50:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3e4c066300 0x7f3e4c0687b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e6c14fa70 0x7f3e6c143c30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6c14f0e0 0x7f3e6c14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 --2- 172.21.15.38:0/919342597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3e6c154ad0 0x7f3e6c154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 >> 172.21.15.38:0/919342597 conn(0x7f3e6c0bfe30 msgr2=0x7f3e6c1496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 shutdown_connections 2023-06-23T18:50:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.832+0000 7f3e71d4e640 1 -- 172.21.15.38:0/919342597 wait complete. 2023-06-23T18:50:18.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:18.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 Processor -- start 2023-06-23T18:50:18.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 -- start start 2023-06-23T18:50:18.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88080be890 0x7f88080c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f88080bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:18.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080c23a0 con 0x7f88080bf1a0 2023-06-23T18:50:18.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080aa080 con 0x7f88080be890 2023-06-23T18:50:18.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880e30a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080bb060 con 0x7f88080a3850 2023-06-23T18:50:18.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f8807fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88080be890 0x7f88080c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880c8a7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f88080bf1a0 0x7f880806a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55406/0 (socket says 172.21.15.38:55406) 2023-06-23T18:50:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f880c8a7640 1 -- 172.21.15.38:0/1881172447 learned_addr learned my addr 172.21.15.38:0/1881172447 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f87fffff640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f88080bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f8807fff640 1 -- 172.21.15.38:0/1881172447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 msgr2=0x7f88080bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:18.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f8807fff640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f88080bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f88077fe640 1 -- 172.21.15.38:0/1881172447 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449383417 0 0) 0x7f88080c23a0 con 0x7f88080bf1a0 2023-06-23T18:50:18.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f8807fff640 1 -- 172.21.15.38:0/1881172447 >> v1:172.21.15.38:6789/0 conn(0x7f88080bf1a0 legacy=0x7f880806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.984+0000 7f8807fff640 1 -- 172.21.15.38:0/1881172447 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080c3b60 con 0x7f88080be890 2023-06-23T18:50:18.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f8807fff640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f88080c0d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097f0 tx=0x7f87f801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec68731d491ce203 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:18.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f88077fe640 1 -- 172.21.15.38:0/1881172447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80ad680 con 0x7f88080be890 2023-06-23T18:50:18.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f88077fe640 1 -- 172.21.15.38:0/1881172447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80ad7e0 con 0x7f88080be890 2023-06-23T18:50:18.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f88077fe640 1 -- 172.21.15.38:0/1881172447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80adb70 con 0x7f88080be890 2023-06-23T18:50:18.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/1881172447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 msgr2=0x7f88080c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f88080c0d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097f0 tx=0x7f87f801c360 comp rx=0 tx=0).stop 2023-06-23T18:50:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/1881172447 shutdown_connections 2023-06-23T18:50:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f88080bec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- 172.21.15.38:0/1881172447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f88080c0d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/1881172447 >> 172.21.15.38:0/1881172447 conn(0x7f88080a5d50 msgr2=0x7f88080a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/1881172447 shutdown_connections 2023-06-23T18:50:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/1881172447 wait complete. 2023-06-23T18:50:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 Processor -- start 2023-06-23T18:50:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- start start 2023-06-23T18:50:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f8808156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88081586d0 0x7f880814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081580f0 con 0x7f88080be890 2023-06-23T18:50:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808157d80 con 0x7f88081586d0 2023-06-23T18:50:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880814d4b0 con 0x7f88080a3850 2023-06-23T18:50:19.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55076/0 (socket says 172.21.15.38:55076) 2023-06-23T18:50:19.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 -- 172.21.15.38:0/733107021 learned_addr learned my addr 172.21.15.38:0/733107021 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:19.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f8807fff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f8808156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880c8a7640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88081586d0 0x7f880814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 -- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 msgr2=0x7f8808156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f8808156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 -- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88081586d0 msgr2=0x7f880814cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88081586d0 0x7f880814cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 -- 172.21.15.38:0/733107021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009420 con 0x7f88080be890 2023-06-23T18:50:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f87fffff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87f000d5f0 tx=0x7f87f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00125f0 con 0x7f88080be890 2023-06-23T18:50:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0012750 con 0x7f88080be890 2023-06-23T18:50:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.988+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808156340 con 0x7f88080be890 2023-06-23T18:50:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0012ae0 con 0x7f88080be890 2023-06-23T18:50:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808156f10 con 0x7f88080be890 2023-06-23T18:50:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880814d7f0 con 0x7f88080be890 2023-06-23T18:50:19.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87f0012c40 con 0x7f88080be890 2023-06-23T18:50:19.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f88057fa640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 0x7f87ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87f0084410 con 0x7f88080be890 2023-06-23T18:50:19.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f8807fff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 0x7f87ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.992+0000 7f8807fff640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 0x7f87ec068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87f80af000 tx=0x7f87f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:18.996+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f880814d7f0 con 0x7f88080be890 2023-06-23T18:50:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f880814d7f0 con 0x7f88080be890 2023-06-23T18:50:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f88057fa640 1 -- 172.21.15.38:0/733107021 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f880814d7f0 con 0x7f88080be890 2023-06-23T18:50:19.160 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:19.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 msgr2=0x7f87ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 0x7f87ec068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87f80af000 tx=0x7f87f80a7000 comp rx=0 tx=0).stop 2023-06-23T18:50:19.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 msgr2=0x7f880814ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87f000d5f0 tx=0x7f87f000dab0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 shutdown_connections 2023-06-23T18:50:19.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f87ec066280 0x7f87ec068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88081586d0 0x7f880814cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88080be890 0x7f880814ca10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 --2- 172.21.15.38:0/733107021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88080a3850 0x7f8808156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 >> 172.21.15.38:0/733107021 conn(0x7f88080a5d50 msgr2=0x7f8808155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 shutdown_connections 2023-06-23T18:50:19.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.152+0000 7f880e30a640 1 -- 172.21.15.38:0/733107021 wait complete. 2023-06-23T18:50:19.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:19.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.300+0000 7f93ee93d640 1 Processor -- start 2023-06-23T18:50:19.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.300+0000 7f93ee93d640 1 -- start start 2023-06-23T18:50:19.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93e80bc310 0x7f93e814a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bba50 0x7f93e814c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e814bfe0 con 0x7f93e806c4b0 2023-06-23T18:50:19.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e814ba20 con 0x7f93e80bc310 2023-06-23T18:50:19.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e814bd00 con 0x7f93e80bba50 2023-06-23T18:50:19.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93e80bc310 0x7f93e814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93e80bc310 0x7f93e814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55090/0 (socket says 172.21.15.38:55090) 2023-06-23T18:50:19.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 -- 172.21.15.38:0/2364041017 learned_addr learned my addr 172.21.15.38:0/2364041017 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:19.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93eceda640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bba50 0x7f93e814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 -- 172.21.15.38:0/2364041017 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bba50 msgr2=0x7f93e814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bba50 0x7f93e814c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 -- 172.21.15.38:0/2364041017 >> v1:172.21.15.81:6789/0 conn(0x7f93e806c4b0 legacy=0x7f93e814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 -- 172.21.15.38:0/2364041017 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80bbe90 con 0x7f93e80bc310 2023-06-23T18:50:19.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e77fe640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bc310 0x7f93e814a860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93d000bb10 tx=0x7f93d001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebd257aecdd9765 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e6ffd640 1 -- 172.21.15.38:0/2364041017 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00a7bf0 con 0x7f93e80bc310 2023-06-23T18:50:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e6ffd640 1 -- 172.21.15.38:0/2364041017 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00a7d50 con 0x7f93e80bc310 2023-06-23T18:50:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93e6ffd640 1 -- 172.21.15.38:0/2364041017 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00af660 con 0x7f93e80bc310 2023-06-23T18:50:19.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- 172.21.15.38:0/2364041017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bc310 msgr2=0x7f93e814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bc310 0x7f93e814a860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93d000bb10 tx=0x7f93d001eb40 comp rx=0 tx=0).stop 2023-06-23T18:50:19.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- 172.21.15.38:0/2364041017 shutdown_connections 2023-06-23T18:50:19.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bba50 0x7f93e814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 --2- 172.21.15.38:0/2364041017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bc310 0x7f93e814a860 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- 172.21.15.38:0/2364041017 >> 172.21.15.38:0/2364041017 conn(0x7f93e80bfe30 msgr2=0x7f93e80c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- 172.21.15.38:0/2364041017 shutdown_connections 2023-06-23T18:50:19.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.304+0000 7f93ee93d640 1 -- 172.21.15.38:0/2364041017 wait complete. 2023-06-23T18:50:19.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 Processor -- start 2023-06-23T18:50:19.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- start start 2023-06-23T18:50:19.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e806c4b0 0x7f93e80b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 0x7f93e813a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e806e380 con 0x7f93e80bba50 2023-06-23T18:50:19.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8141590 con 0x7f93e806c4b0 2023-06-23T18:50:19.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e806def0 con 0x7f93e80bc310 2023-06-23T18:50:19.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55094/0 (socket says 172.21.15.38:55094) 2023-06-23T18:50:19.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 -- 172.21.15.38:0/3766867821 learned_addr learned my addr 172.21.15.38:0/3766867821 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:19.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93eceda640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 0x7f93e813a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e7fff640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e806c4b0 0x7f93e80b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 -- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 msgr2=0x7f93e813a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 0x7f93e813a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 -- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e806c4b0 msgr2=0x7f93e80b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e806c4b0 0x7f93e80b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 -- 172.21.15.38:0/3766867821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d000b770 con 0x7f93e80bba50 2023-06-23T18:50:19.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93eceda640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 0x7f93e813a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:19.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e77fe640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b2c0 tx=0x7f93d001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00ba660 con 0x7f93e80bba50 2023-06-23T18:50:19.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00ba7e0 con 0x7f93e80bba50 2023-06-23T18:50:19.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80b9e50 con 0x7f93e80bba50 2023-06-23T18:50:19.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00bab90 con 0x7f93e80bba50 2023-06-23T18:50:19.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e81412b0 con 0x7f93e80bba50 2023-06-23T18:50:19.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.308+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e806e080 con 0x7f93e80bba50 2023-06-23T18:50:19.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.312+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93d00c33b0 con 0x7f93e80bba50 2023-06-23T18:50:19.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.312+0000 7f93e4ff9640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 0x7f93c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.312+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f93d011f0f0 con 0x7f93e80bba50 2023-06-23T18:50:19.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.312+0000 7f93e7fff640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 0x7f93c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.312+0000 7f93e7fff640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 0x7f93c8068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f93e8145a70 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.316+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93d00ec2f0 con 0x7f93e80bba50 2023-06-23T18:50:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.464+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f93e804d790 con 0x7f93e80bba50 2023-06-23T18:50:19.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93e4ff9640 1 -- 172.21.15.38:0/3766867821 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93d00ef910 con 0x7f93e80bba50 2023-06-23T18:50:19.475 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:19.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 msgr2=0x7f93c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 0x7f93c8068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f93e8145a70 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2023-06-23T18:50:19.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 msgr2=0x7f93e8139f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f93d000b2c0 tx=0x7f93d001b8e0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 shutdown_connections 2023-06-23T18:50:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f93c8066280 0x7f93c8068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f93e80bc310 0x7f93e813a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93e80bba50 0x7f93e8139f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 --2- 172.21.15.38:0/3766867821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e806c4b0 0x7f93e80b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 >> 172.21.15.38:0/3766867821 conn(0x7f93e80bfe30 msgr2=0x7f93e81485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 shutdown_connections 2023-06-23T18:50:19.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.468+0000 7f93ee93d640 1 -- 172.21.15.38:0/3766867821 wait complete. 2023-06-23T18:50:19.494 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:19.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 Processor -- start 2023-06-23T18:50:19.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 -- start start 2023-06-23T18:50:19.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d9006a630 0x7f7d9014caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d900ba9d0 con 0x7f7d900bd1e0 2023-06-23T18:50:19.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d90150160 con 0x7f7d9014b930 2023-06-23T18:50:19.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d96eda640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900bc300 con 0x7f7d9006a630 2023-06-23T18:50:19.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7d900bd1e0 0x7f7d9014c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55410/0 (socket says 172.21.15.38:55410) 2023-06-23T18:50:19.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 -- 172.21.15.38:0/3679705742 learned_addr learned my addr 172.21.15.38:0/3679705742 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:19.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d95477640 1 --2- 172.21.15.38:0/3679705742 >> v2:172.21.15.81:3300/0 conn(0x7f7d9006a630 0x7f7d9014caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525969875 0 0) 0x7f7d900ba9d0 con 0x7f7d900bd1e0 2023-06-23T18:50:19.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d78003530 con 0x7f7d900bd1e0 2023-06-23T18:50:19.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 774732383 0 0) 0x7f7d78003530 con 0x7f7d900bd1e0 2023-06-23T18:50:19.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 >> v2:172.21.15.81:3300/0 conn(0x7f7d9006a630 msgr2=0x7f7d9014caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 --2- 172.21.15.38:0/3679705742 >> v2:172.21.15.81:3300/0 conn(0x7f7d9006a630 0x7f7d9014caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 >> v1:172.21.15.81:6789/0 conn(0x7f7d9014b930 legacy=0x7f7d9006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90150440 con 0x7f7d900bd1e0 2023-06-23T18:50:19.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f7d84001680 con 0x7f7d900bd1e0 2023-06-23T18:50:19.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 >> v1:172.21.15.38:6789/0 conn(0x7f7d900bd1e0 legacy=0x7f7d9014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d78003980 0x7f7d78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 0x7f7d78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d78005180 0x7f7d7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900bc300 con 0x7f7d780047d0 2023-06-23T18:50:19.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800c000 con 0x7f7d78005180 2023-06-23T18:50:19.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800c1c0 con 0x7f7d78003980 2023-06-23T18:50:19.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 0x7f7d78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d95477640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d78005180 0x7f7d7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d94c76640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d78003980 0x7f7d78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 -- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d78003980 msgr2=0x7f7d78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d78003980 0x7f7d78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 -- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d78005180 msgr2=0x7f7d7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d78005180 0x7f7d7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d8ffff640 1 -- 172.21.15.38:0/3679705742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78003530 con 0x7f7d780047d0 2023-06-23T18:50:19.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.612+0000 7f7d95477640 1 -- 172.21.15.38:0/3679705742 reap_dead start 2023-06-23T18:50:19.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 0x7f7d78004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c240 tx=0x7f7d8401f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2031efcedc5e474 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a8e50 con 0x7f7d780047d0 2023-06-23T18:50:19.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840058e0 con 0x7f7d780047d0 2023-06-23T18:50:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d8f7fe640 1 -- 172.21.15.38:0/3679705742 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84005cb0 con 0x7f7d780047d0 2023-06-23T18:50:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 msgr2=0x7f7d78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 0x7f7d78004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c240 tx=0x7f7d8401f330 comp rx=0 tx=0).stop 2023-06-23T18:50:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- 172.21.15.38:0/3679705742 shutdown_connections 2023-06-23T18:50:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 --2- 172.21.15.38:0/3679705742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d780047d0 0x7f7d78004c40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- 172.21.15.38:0/3679705742 >> 172.21.15.38:0/3679705742 conn(0x7f7d900c0c90 msgr2=0x7f7d900bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- 172.21.15.38:0/3679705742 shutdown_connections 2023-06-23T18:50:19.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- 172.21.15.38:0/3679705742 wait complete. 2023-06-23T18:50:19.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 Processor -- start 2023-06-23T18:50:19.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.616+0000 7f7d96eda640 1 -- start start 2023-06-23T18:50:19.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 0x7f7d901e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d9006e050 0x7f7d9006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900a5570 con 0x7f7d9009ac50 2023-06-23T18:50:19.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d901e70b0 con 0x7f7d780047d0 2023-06-23T18:50:19.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9009a850 con 0x7f7d9006e050 2023-06-23T18:50:19.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55120/0 (socket says 172.21.15.38:55120) 2023-06-23T18:50:19.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 -- 172.21.15.38:0/1025609321 learned_addr learned my addr 172.21.15.38:0/1025609321 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:19.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d94c76640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 0x7f7d901e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 -- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d9006e050 msgr2=0x7f7d9006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d95477640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d9006e050 0x7f7d9006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d9006e050 0x7f7d9006e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 -- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 msgr2=0x7f7d901e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 0x7f7d901e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 -- 172.21.15.38:0/1025609321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90098de0 con 0x7f7d9009ac50 2023-06-23T18:50:19.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d94c76640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 0x7f7d901e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:19.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8ffff640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401f160 tx=0x7f7d78005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b7070 con 0x7f7d9009ac50 2023-06-23T18:50:19.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84001540 con 0x7f7d9009ac50 2023-06-23T18:50:19.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84005c90 con 0x7f7d9009ac50 2023-06-23T18:50:19.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d90099080 con 0x7f7d9009ac50 2023-06-23T18:50:19.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d901e7610 con 0x7f7d9009ac50 2023-06-23T18:50:19.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9004d790 con 0x7f7d9009ac50 2023-06-23T18:50:19.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d84007030 con 0x7f7d9009ac50 2023-06-23T18:50:19.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 0x7f7d7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7d84120850 con 0x7f7d9009ac50 2023-06-23T18:50:19.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.620+0000 7f7d94c76640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 0x7f7d7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.624+0000 7f7d94c76640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 0x7f7d7c068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.624+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d840ed9e0 con 0x7f7d9009ac50 2023-06-23T18:50:19.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.784+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d90066f10 con 0x7f7d9009ac50 2023-06-23T18:50:19.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.784+0000 7f7d8d7fa640 1 -- 172.21.15.38:0/1025609321 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7d840f1000 con 0x7f7d9009ac50 2023-06-23T18:50:19.793 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:19.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 msgr2=0x7f7d7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 0x7f7d7c068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80009040 comp rx=0 tx=0).stop 2023-06-23T18:50:19.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 msgr2=0x7f7d9009a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401f160 tx=0x7f7d78005800 comp rx=0 tx=0).stop 2023-06-23T18:50:19.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 shutdown_connections 2023-06-23T18:50:19.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7d7c066280 0x7f7d7c068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d9006e050 0x7f7d9006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9009ac50 0x7f7d9009a310 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 --2- 172.21.15.38:0/1025609321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d780047d0 0x7f7d901e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 >> 172.21.15.38:0/1025609321 conn(0x7f7d900c0c90 msgr2=0x7f7d901489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 shutdown_connections 2023-06-23T18:50:19.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.788+0000 7f7d96eda640 1 -- 172.21.15.38:0/1025609321 wait complete. 2023-06-23T18:50:19.810 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-06-23T18:50:19.810 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:19.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:19.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.928+0000 7f7fb1150640 1 Processor -- start 2023-06-23T18:50:19.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.928+0000 7f7fb1150640 1 -- start start 2023-06-23T18:50:19.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fb1150640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 0x7f7fac0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fb1150640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 0x7f7fac14e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fb1150640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0bd410 con 0x7f7fac071290 2023-06-23T18:50:19.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fb1150640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0a53a0 con 0x7f7fac06a630 2023-06-23T18:50:19.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fb1150640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac151a00 con 0x7f7fac06c6d0 2023-06-23T18:50:19.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 0x7f7fac0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faa59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7fac071290 0x7f7fac0b9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:60808/0 (socket says 172.21.15.38:60808) 2023-06-23T18:50:19.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faa59c640 1 -- 172.21.15.38:0/3585349078 learned_addr learned my addr 172.21.15.38:0/3585349078 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:19.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fab59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 0x7f7fac14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 -- 172.21.15.38:0/3585349078 >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 msgr2=0x7f7fac14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 --2- 172.21.15.38:0/3585349078 >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 0x7f7fac14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 -- 172.21.15.38:0/3585349078 >> v1:172.21.15.81:6789/0 conn(0x7f7fac071290 legacy=0x7f7fac0b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 -- 172.21.15.38:0/3585349078 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac06a310 con 0x7f7fac06c6d0 2023-06-23T18:50:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fab59e640 1 --2- 172.21.15.38:0/3585349078 >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 0x7f7fac14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:50:19.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7faad9d640 1 --2- 172.21.15.38:0/3585349078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 0x7f7fac0b93e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009d90 tx=0x7f7f9c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8adbb94f93599975 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fa9d9b640 1 -- 172.21.15.38:0/3585349078 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a5810 con 0x7f7fac06c6d0 2023-06-23T18:50:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fa9d9b640 1 -- 172.21.15.38:0/3585349078 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a5970 con 0x7f7fac06c6d0 2023-06-23T18:50:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.932+0000 7f7fa9d9b640 1 -- 172.21.15.38:0/3585349078 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a5d00 con 0x7f7fac06c6d0 2023-06-23T18:50:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/3585349078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 msgr2=0x7f7fac0b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- 172.21.15.38:0/3585349078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 0x7f7fac0b93e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009d90 tx=0x7f7f9c01c950 comp rx=0 tx=0).stop 2023-06-23T18:50:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/3585349078 shutdown_connections 2023-06-23T18:50:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- 172.21.15.38:0/3585349078 >> v2:172.21.15.81:3300/0 conn(0x7f7fac06a630 0x7f7fac14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- 172.21.15.38:0/3585349078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06c6d0 0x7f7fac0b93e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/3585349078 >> 172.21.15.38:0/3585349078 conn(0x7f7fac0c0c90 msgr2=0x7f7fac0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:19.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/3585349078 shutdown_connections 2023-06-23T18:50:19.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/3585349078 wait complete. 2023-06-23T18:50:19.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 Processor -- start 2023-06-23T18:50:19.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- start start 2023-06-23T18:50:19.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 0x7f7fac0be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac06c6d0 0x7f7fac141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac150f30 con 0x7f7fac071290 2023-06-23T18:50:19.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0be5f0 con 0x7f7fac06c6d0 2023-06-23T18:50:19.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0bfe00 con 0x7f7fac06a630 2023-06-23T18:50:19.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55134/0 (socket says 172.21.15.38:55134) 2023-06-23T18:50:19.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 -- 172.21.15.38:0/2521511232 learned_addr learned my addr 172.21.15.38:0/2521511232 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:19.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7faad9d640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 0x7f7fac0be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7faa59c640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac06c6d0 0x7f7fac141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 -- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 msgr2=0x7f7fac0be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 0x7f7fac0be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 -- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac06c6d0 msgr2=0x7f7fac141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:19.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac06c6d0 0x7f7fac141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:19.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 -- 172.21.15.38:0/2521511232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009420 con 0x7f7fac071290 2023-06-23T18:50:19.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7faad9d640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 0x7f7fac0be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:19.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fab59e640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e950 tx=0x7f7fa400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4009720 con 0x7f7fac071290 2023-06-23T18:50:19.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400ca00 con 0x7f7fac071290 2023-06-23T18:50:19.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c009a70 con 0x7f7fac071290 2023-06-23T18:50:19.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400cd90 con 0x7f7fac071290 2023-06-23T18:50:19.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.936+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac144390 con 0x7f7fac071290 2023-06-23T18:50:19.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac0bfc30 con 0x7f7fac071290 2023-06-23T18:50:19.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fa4013470 con 0x7f7fac071290 2023-06-23T18:50:19.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7f937fe640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:19.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fa4083ca0 con 0x7f7fac071290 2023-06-23T18:50:19.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7faad9d640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:19.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.940+0000 7f7faad9d640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0af000 tx=0x7f7f9c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:19.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:19.944+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fa4050e40 con 0x7f7fac071290 2023-06-23T18:50:20.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.092+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fac04d790 con 0x7f7fac071290 2023-06-23T18:50:20.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7f937fe640 1 -- 172.21.15.38:0/2521511232 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f7fa4054460 con 0x7f7fac071290 2023-06-23T18:50:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:20.105 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:20.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 msgr2=0x7f7f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0af000 tx=0x7f7f9c0a7070 comp rx=0 tx=0).stop 2023-06-23T18:50:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 msgr2=0x7f7fac1416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e950 tx=0x7f7fa400ee10 comp rx=0 tx=0).stop 2023-06-23T18:50:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 shutdown_connections 2023-06-23T18:50:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fac071290 0x7f7fac1416b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac06c6d0 0x7f7fac141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 --2- 172.21.15.38:0/2521511232 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7fac06a630 0x7f7fac0be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 >> 172.21.15.38:0/2521511232 conn(0x7f7fac0c0c90 msgr2=0x7f7fac0b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 shutdown_connections 2023-06-23T18:50:20.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.096+0000 7f7fb1150640 1 -- 172.21.15.38:0/2521511232 wait complete. 2023-06-23T18:50:20.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:20.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:20.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 Processor -- start 2023-06-23T18:50:20.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 -- start start 2023-06-23T18:50:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19406c4b0 0x7fe1940c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe19414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe194149270 0x7fe1941496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1941504e0 con 0x7fe194149270 2023-06-23T18:50:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe194070270 con 0x7fe19406c4b0 2023-06-23T18:50:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19c14a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe194149c30 con 0x7fe1940ba7f0 2023-06-23T18:50:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe194149270 0x7fe1941496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe194149270 0x7fe1941496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55138/0 (socket says 172.21.15.38:55138) 2023-06-23T18:50:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 -- 172.21.15.38:0/1773148120 learned_addr learned my addr 172.21.15.38:0/1773148120 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe1996e5640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe19414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe199ee6640 1 --2- 172.21.15.38:0/1773148120 >> v2:172.21.15.81:3300/0 conn(0x7fe19406c4b0 0x7fe1940c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 -- 172.21.15.38:0/1773148120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 msgr2=0x7fe19414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe19414bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 -- 172.21.15.38:0/1773148120 >> v2:172.21.15.81:3300/0 conn(0x7fe19406c4b0 msgr2=0x7fe1940c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 --2- 172.21.15.38:0/1773148120 >> v2:172.21.15.81:3300/0 conn(0x7fe19406c4b0 0x7fe1940c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe19a6e7640 1 -- 172.21.15.38:0/1773148120 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19414ff20 con 0x7fe194149270 2023-06-23T18:50:20.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.240+0000 7fe1996e5640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe19414bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19a6e7640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe194149270 0x7fe1941496f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe19406dc30 tx=0x7fe18c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5d118a3ce47580 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe198ee4640 1 -- 172.21.15.38:0/1773148120 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0a56d0 con 0x7fe194149270 2023-06-23T18:50:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe198ee4640 1 -- 172.21.15.38:0/1773148120 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c0a5830 con 0x7fe194149270 2023-06-23T18:50:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe198ee4640 1 -- 172.21.15.38:0/1773148120 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0a5bc0 con 0x7fe194149270 2023-06-23T18:50:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- 172.21.15.38:0/1773148120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe194149270 msgr2=0x7fe1941496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe194149270 0x7fe1941496f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe19406dc30 tx=0x7fe18c01c940 comp rx=0 tx=0).stop 2023-06-23T18:50:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- 172.21.15.38:0/1773148120 shutdown_connections 2023-06-23T18:50:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe194149270 0x7fe1941496f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- 172.21.15.38:0/1773148120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe19414bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- 172.21.15.38:0/1773148120 >> v2:172.21.15.81:3300/0 conn(0x7fe19406c4b0 0x7fe1940c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- 172.21.15.38:0/1773148120 >> 172.21.15.38:0/1773148120 conn(0x7fe1940bfe30 msgr2=0x7fe1940c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- 172.21.15.38:0/1773148120 shutdown_connections 2023-06-23T18:50:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- 172.21.15.38:0/1773148120 wait complete. 2023-06-23T18:50:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 Processor -- start 2023-06-23T18:50:20.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- start start 2023-06-23T18:50:20.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe1940b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 0x7fe1940b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194155ef0 con 0x7fe19406c4b0 2023-06-23T18:50:20.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940b9f00 con 0x7fe194149270 2023-06-23T18:50:20.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19c14a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1941e4a90 con 0x7fe1940ba7f0 2023-06-23T18:50:20.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55142/0 (socket says 172.21.15.38:55142) 2023-06-23T18:50:20.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 -- 172.21.15.38:0/478631565 learned_addr learned my addr 172.21.15.38:0/478631565 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:20.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe1996e5640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe1940b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19a6e7640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 0x7fe1940b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 -- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 msgr2=0x7fe1940b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe1940b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 -- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 msgr2=0x7fe1940b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 0x7fe1940b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 -- 172.21.15.38:0/478631565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c009b30 con 0x7fe19406c4b0 2023-06-23T18:50:20.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe19a6e7640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 0x7fe1940b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:20.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.244+0000 7fe199ee6640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c7f0 tx=0x7fe19000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190004220 con 0x7fe19406c4b0 2023-06-23T18:50:20.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190004380 con 0x7fe19406c4b0 2023-06-23T18:50:20.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1941e4d70 con 0x7fe19406c4b0 2023-06-23T18:50:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190003860 con 0x7fe19406c4b0 2023-06-23T18:50:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe194148070 con 0x7fe19406c4b0 2023-06-23T18:50:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19404d790 con 0x7fe19406c4b0 2023-06-23T18:50:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe190003bd0 con 0x7fe19406c4b0 2023-06-23T18:50:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 0x7fe178068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe190083ff0 con 0x7fe19406c4b0 2023-06-23T18:50:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe1996e5640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 0x7fe178068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.248+0000 7fe1996e5640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 0x7fe178068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe194148430 tx=0x7fe184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.252+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1900510f0 con 0x7fe19406c4b0 2023-06-23T18:50:20.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.400+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe194149f10 con 0x7fe19406c4b0 2023-06-23T18:50:20.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.400+0000 7fe18a7fc640 1 -- 172.21.15.38:0/478631565 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe19001e020 con 0x7fe19406c4b0 2023-06-23T18:50:20.410 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:20.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 msgr2=0x7fe178068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 0x7fe178068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe194148430 tx=0x7fe184008040 comp rx=0 tx=0).stop 2023-06-23T18:50:20.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 msgr2=0x7fe1940b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c7f0 tx=0x7fe19000ccb0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 shutdown_connections 2023-06-23T18:50:20.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe178066280 0x7fe178068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194149270 0x7fe1940b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1940ba7f0 0x7fe1940b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 --2- 172.21.15.38:0/478631565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe19406c4b0 0x7fe1940b99c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 >> 172.21.15.38:0/478631565 conn(0x7fe1940bfe30 msgr2=0x7fe194144e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 shutdown_connections 2023-06-23T18:50:20.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.404+0000 7fe19c14a640 1 -- 172.21.15.38:0/478631565 wait complete. 2023-06-23T18:50:20.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 Processor -- start 2023-06-23T18:50:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 -- start start 2023-06-23T18:50:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 0x7f780c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c070270 con 0x7f780c0ba7f0 2023-06-23T18:50:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c1504e0 con 0x7f780c149980 2023-06-23T18:50:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f7811cfe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c14ff20 con 0x7f780c06c4b0 2023-06-23T18:50:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 0x7f780c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f780c0ba7f0 0x7f780c149270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:60810/0 (socket says 172.21.15.38:60810) 2023-06-23T18:50:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780affd640 1 -- 172.21.15.38:0/4018853171 learned_addr learned my addr 172.21.15.38:0/4018853171 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 0x7f780c14bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:38154/0 (socket says 172.21.15.38:38154) 2023-06-23T18:50:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780b7fe640 1 -- 172.21.15.38:0/4018853171 >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 msgr2=0x7f780c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780b7fe640 1 --2- 172.21.15.38:0/4018853171 >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 0x7f780c14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780b7fe640 1 -- 172.21.15.38:0/4018853171 >> v1:172.21.15.81:6789/0 conn(0x7f780c0ba7f0 legacy=0x7f780c149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.540+0000 7f780b7fe640 1 -- 172.21.15.38:0/4018853171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c150200 con 0x7f780c06c4b0 2023-06-23T18:50:20.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f780b7fe640 1 --2- 172.21.15.38:0/4018853171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c0c09d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0097c0 tx=0x7f77fc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfebfedb3dc0c3b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f780a7fc640 1 -- 172.21.15.38:0/4018853171 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab600 con 0x7f780c06c4b0 2023-06-23T18:50:20.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f780a7fc640 1 -- 172.21.15.38:0/4018853171 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0a7050 con 0x7f780c06c4b0 2023-06-23T18:50:20.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f780a7fc640 1 -- 172.21.15.38:0/4018853171 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab980 con 0x7f780c06c4b0 2023-06-23T18:50:20.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- 172.21.15.38:0/4018853171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 msgr2=0x7f780c0c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 --2- 172.21.15.38:0/4018853171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c0c09d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0097c0 tx=0x7f77fc01c3f0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- 172.21.15.38:0/4018853171 shutdown_connections 2023-06-23T18:50:20.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 --2- 172.21.15.38:0/4018853171 >> v2:172.21.15.81:3300/0 conn(0x7f780c149980 0x7f780c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 --2- 172.21.15.38:0/4018853171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c0c09d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- 172.21.15.38:0/4018853171 >> 172.21.15.38:0/4018853171 conn(0x7f780c0bfe30 msgr2=0x7f780c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- 172.21.15.38:0/4018853171 shutdown_connections 2023-06-23T18:50:20.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- 172.21.15.38:0/4018853171 wait complete. 2023-06-23T18:50:20.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 Processor -- start 2023-06-23T18:50:20.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.544+0000 7f7811cfe640 1 -- start start 2023-06-23T18:50:20.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 0x7f780c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c13fc60 con 0x7f780c0ba7f0 2023-06-23T18:50:20.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c13fea0 con 0x7f780c149980 2023-06-23T18:50:20.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1e7e00 con 0x7f780c06c4b0 2023-06-23T18:50:20.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55150/0 (socket says 172.21.15.38:55150) 2023-06-23T18:50:20.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 -- 172.21.15.38:0/2326032723 learned_addr learned my addr 172.21.15.38:0/2326032723 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:20.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780b7fe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780bfff640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 0x7f780c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 -- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 msgr2=0x7f780c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 -- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 msgr2=0x7f780c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 0x7f780c1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 -- 172.21.15.38:0/2326032723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009420 con 0x7f780c0ba7f0 2023-06-23T18:50:20.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780bfff640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 0x7f780c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:20.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f780affd640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780000c500 tx=0x7f780000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800005cf0 con 0x7f780c0ba7f0 2023-06-23T18:50:20.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800005e50 con 0x7f780c0ba7f0 2023-06-23T18:50:20.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c13f9a0 con 0x7f780c0ba7f0 2023-06-23T18:50:20.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000072f0 con 0x7f780c0ba7f0 2023-06-23T18:50:20.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c1e7ba0 con 0x7f780c0ba7f0 2023-06-23T18:50:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c14eff0 con 0x7f780c0ba7f0 2023-06-23T18:50:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7800007450 con 0x7f780c0ba7f0 2023-06-23T18:50:20.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 0x7f77f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.548+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7800083430 con 0x7f780c0ba7f0 2023-06-23T18:50:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.552+0000 7f780b7fe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 0x7f77f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.552+0000 7f780b7fe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 0x7f77f8068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ad000 tx=0x7f77fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.556+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7800050700 con 0x7f780c0ba7f0 2023-06-23T18:50:20.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.712+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f780c04d790 con 0x7f780c0ba7f0 2023-06-23T18:50:20.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.712+0000 7f77f3fff640 1 -- 172.21.15.38:0/2326032723 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7800053d20 con 0x7f780c0ba7f0 2023-06-23T18:50:20.722 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:20.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 msgr2=0x7f77f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 0x7f77f8068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ad000 tx=0x7f77fc0a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:20.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 msgr2=0x7f780c1e7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f780000c500 tx=0x7f780000c9c0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 shutdown_connections 2023-06-23T18:50:20.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f77f80662b0 0x7f77f8068760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f780c149980 0x7f780c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f780c0ba7f0 0x7f780c1e7490 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 --2- 172.21.15.38:0/2326032723 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f780c06c4b0 0x7f780c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 >> 172.21.15.38:0/2326032723 conn(0x7f780c0bfe30 msgr2=0x7f780c1486e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 shutdown_connections 2023-06-23T18:50:20.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.716+0000 7f7811cfe640 1 -- 172.21.15.38:0/2326032723 wait complete. 2023-06-23T18:50:20.741 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 Processor -- start 2023-06-23T18:50:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 -- start start 2023-06-23T18:50:20.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47d80c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80c23a0 con 0x7f47d80a3270 2023-06-23T18:50:20.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80bf370 con 0x7f47d80a3850 2023-06-23T18:50:20.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47deb9f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80aa080 con 0x7f47d80be890 2023-06-23T18:50:20.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dd13c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f47d80a3270 0x7f47d8151a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55426/0 (socket says 172.21.15.38:55426) 2023-06-23T18:50:20.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dd13c640 1 -- 172.21.15.38:0/2717232965 learned_addr learned my addr 172.21.15.38:0/2717232965 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:20.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dc93b640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47d80c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957477325 0 0) 0x7f47d80c23a0 con 0x7f47d80a3270 2023-06-23T18:50:20.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c0003530 con 0x7f47d80a3270 2023-06-23T18:50:20.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3841504515 0 0) 0x7f47c0003530 con 0x7f47d80a3270 2023-06-23T18:50:20.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 msgr2=0x7f47d80c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47d80c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 >> v1:172.21.15.81:6789/0 conn(0x7f47d80a3850 legacy=0x7f47d80bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80bb060 con 0x7f47d80a3270 2023-06-23T18:50:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f47d0001a00 con 0x7f47d80a3270 2023-06-23T18:50:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 >> v1:172.21.15.38:6789/0 conn(0x7f47d80a3270 legacy=0x7f47d8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00039b0 0x7f47c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80aa080 con 0x7f47c00047d0 2023-06-23T18:50:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000bac0 con 0x7f47c00039b0 2023-06-23T18:50:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c000bc80 con 0x7f47d80be890 2023-06-23T18:50:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dd13c640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dc93b640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00039b0 0x7f47c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 -- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 msgr2=0x7f47c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 -- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00039b0 msgr2=0x7f47c0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00039b0 0x7f47c0003d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47d7fff640 1 -- 172.21.15.38:0/2717232965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0003530 con 0x7f47c00047d0 2023-06-23T18:50:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.848+0000 7f47dd13c640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d80be890 0x7f47c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47d7fff640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47c0004c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f47c8001860 tx=0x7f47c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18228419a393d7ed server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab600 con 0x7f47c00047d0 2023-06-23T18:50:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80a7050 con 0x7f47c00047d0 2023-06-23T18:50:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47d77fe640 1 -- 172.21.15.38:0/2717232965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab9a0 con 0x7f47c00047d0 2023-06-23T18:50:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 -- 172.21.15.38:0/2717232965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 msgr2=0x7f47c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 --2- 172.21.15.38:0/2717232965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47c0004c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f47c8001860 tx=0x7f47c801c3d0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47dd13c640 1 -- 172.21.15.38:0/2717232965 reap_dead start 2023-06-23T18:50:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 -- 172.21.15.38:0/2717232965 shutdown_connections 2023-06-23T18:50:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 -- 172.21.15.38:0/2717232965 >> 172.21.15.38:0/2717232965 conn(0x7f47d80a5d50 msgr2=0x7f47d80a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 -- 172.21.15.38:0/2717232965 shutdown_connections 2023-06-23T18:50:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 -- 172.21.15.38:0/2717232965 wait complete. 2023-06-23T18:50:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.852+0000 7f47deb9f640 1 Processor -- start 2023-06-23T18:50:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- start start 2023-06-23T18:50:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d814d4f0 0x7f47d814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 0x7f47d814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d814e8f0 con 0x7f47c00047d0 2023-06-23T18:50:20.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d814ed80 con 0x7f47d814cfa0 2023-06-23T18:50:20.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80bdc80 con 0x7f47d814d4f0 2023-06-23T18:50:20.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55172/0 (socket says 172.21.15.38:55172) 2023-06-23T18:50:20.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 -- 172.21.15.38:0/3096107110 learned_addr learned my addr 172.21.15.38:0/3096107110 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:20.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d7fff640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d814d4f0 0x7f47d814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dd13c640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 0x7f47d814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 -- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d814d4f0 msgr2=0x7f47d814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d814d4f0 0x7f47d814c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 -- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 msgr2=0x7f47d814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 0x7f47d814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 -- 172.21.15.38:0/3096107110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d81dcf40 con 0x7f47c00047d0 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dd13c640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 0x7f47d814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47dc93b640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0108c0 tx=0x7f47cc010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc009630 con 0x7f47c00047d0 2023-06-23T18:50:20.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc00eb60 con 0x7f47c00047d0 2023-06-23T18:50:20.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d81dd220 con 0x7f47c00047d0 2023-06-23T18:50:20.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc01c400 con 0x7f47c00047d0 2023-06-23T18:50:20.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d8151190 con 0x7f47c00047d0 2023-06-23T18:50:20.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d804d790 con 0x7f47c00047d0 2023-06-23T18:50:20.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47cc01c560 con 0x7f47c00047d0 2023-06-23T18:50:20.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 0x7f47c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:20.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f47cc084530 con 0x7f47c00047d0 2023-06-23T18:50:20.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.856+0000 7f47d7fff640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 0x7f47c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:20.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.860+0000 7f47d7fff640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 0x7f47c4068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:20.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:20.860+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47cc055290 con 0x7f47c00047d0 2023-06-23T18:50:21.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47d80a9890 con 0x7f47c00047d0 2023-06-23T18:50:21.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47d57fa640 1 -- 172.21.15.38:0/3096107110 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47cc054e20 con 0x7f47c00047d0 2023-06-23T18:50:21.017 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 msgr2=0x7f47c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 0x7f47c4068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c80a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 msgr2=0x7f47d80bd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0108c0 tx=0x7f47cc010d80 comp rx=0 tx=0).stop 2023-06-23T18:50:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 shutdown_connections 2023-06-23T18:50:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f47c40662b0 0x7f47c4068760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d814cfa0 0x7f47d814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47d814d4f0 0x7f47d814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 --2- 172.21.15.38:0/3096107110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47c00047d0 0x7f47d80bd740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.008+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 >> 172.21.15.38:0/3096107110 conn(0x7f47d80a5d50 msgr2=0x7f47d80a3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.012+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 shutdown_connections 2023-06-23T18:50:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.012+0000 7f47deb9f640 1 -- 172.21.15.38:0/3096107110 wait complete. 2023-06-23T18:50:21.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 Processor -- start 2023-06-23T18:50:21.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 -- start start 2023-06-23T18:50:21.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ab00712c0 0x7f1ab014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 0x7f1ab014c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab014fd20 con 0x7f1ab0131d80 2023-06-23T18:50:21.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab00b8270 con 0x7f1ab00712c0 2023-06-23T18:50:21.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1ab4aad640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab0132150 con 0x7f1ab0134f90 2023-06-23T18:50:21.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aadd9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ab00712c0 0x7f1ab014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aae59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1ab0131d80 0x7f1ab0070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55438/0 (socket says 172.21.15.38:55438) 2023-06-23T18:50:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aae59c640 1 -- 172.21.15.38:0/3921340214 learned_addr learned my addr 172.21.15.38:0/3921340214 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aaed9d640 1 --2- 172.21.15.38:0/3921340214 >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 0x7f1ab014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aadd9b640 1 -- 172.21.15.38:0/3921340214 >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 msgr2=0x7f1ab014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aadd9b640 1 --2- 172.21.15.38:0/3921340214 >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 0x7f1ab014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aadd9b640 1 -- 172.21.15.38:0/3921340214 >> v1:172.21.15.38:6789/0 conn(0x7f1ab0131d80 legacy=0x7f1ab0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aadd9b640 1 -- 172.21.15.38:0/3921340214 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0150250 con 0x7f1ab00712c0 2023-06-23T18:50:21.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aaed9d640 1 --2- 172.21.15.38:0/3921340214 >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 0x7f1ab014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:21.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.156+0000 7f1aad59a640 1 -- 172.21.15.38:0/3921340214 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145428511 0 0) 0x7f1ab014fd20 con 0x7f1ab0131d80 2023-06-23T18:50:21.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aadd9b640 1 --2- 172.21.15.38:0/3921340214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab00712c0 0x7f1ab014bd10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00bfd40 tx=0x7f1aa401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1d81c819f2307c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aad59a640 1 -- 172.21.15.38:0/3921340214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40ab600 con 0x7f1ab00712c0 2023-06-23T18:50:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aad59a640 1 -- 172.21.15.38:0/3921340214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40a7050 con 0x7f1ab00712c0 2023-06-23T18:50:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aad59a640 1 -- 172.21.15.38:0/3921340214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40ab980 con 0x7f1ab00712c0 2023-06-23T18:50:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3921340214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab00712c0 msgr2=0x7f1ab014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3921340214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab00712c0 0x7f1ab014bd10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00bfd40 tx=0x7f1aa401c310 comp rx=0 tx=0).stop 2023-06-23T18:50:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3921340214 shutdown_connections 2023-06-23T18:50:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3921340214 >> v2:172.21.15.81:3300/0 conn(0x7f1ab0134f90 0x7f1ab014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3921340214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab00712c0 0x7f1ab014bd10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3921340214 >> 172.21.15.38:0/3921340214 conn(0x7f1ab00c1fd0 msgr2=0x7f1ab00c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3921340214 shutdown_connections 2023-06-23T18:50:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3921340214 wait complete. 2023-06-23T18:50:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 Processor -- start 2023-06-23T18:50:21.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- start start 2023-06-23T18:50:21.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ab00712c0 0x7f1ab00b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ab0131d80 0x7f1ab012e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab014dba0 con 0x7f1ab0134f90 2023-06-23T18:50:21.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab01449d0 con 0x7f1ab0131d80 2023-06-23T18:50:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab014dd80 con 0x7f1ab00712c0 2023-06-23T18:50:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55188/0 (socket says 172.21.15.38:55188) 2023-06-23T18:50:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 -- 172.21.15.38:0/3369390206 learned_addr learned my addr 172.21.15.38:0/3369390206 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:21.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aadd9b640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ab0131d80 0x7f1ab012e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 -- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ab00712c0 msgr2=0x7f1ab00b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ab00712c0 0x7f1ab00b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 -- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ab0131d80 msgr2=0x7f1ab012e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ab0131d80 0x7f1ab012e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 -- 172.21.15.38:0/3369390206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4009420 con 0x7f1ab0134f90 2023-06-23T18:50:21.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1aaed9d640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800cd50 tx=0x7f1aa800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800f680 con 0x7f1ab0134f90 2023-06-23T18:50:21.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa800f800 con 0x7f1ab0134f90 2023-06-23T18:50:21.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800fbb0 con 0x7f1ab0134f90 2023-06-23T18:50:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab00b7bc0 con 0x7f1ab0134f90 2023-06-23T18:50:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.160+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab012f140 con 0x7f1ab0134f90 2023-06-23T18:50:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab004d790 con 0x7f1ab0134f90 2023-06-23T18:50:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1aa800b040 con 0x7f1ab0134f90 2023-06-23T18:50:21.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1a9effd640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 0x7f1a90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1aa80849d0 con 0x7f1ab0134f90 2023-06-23T18:50:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1aae59c640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 0x7f1a90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.164+0000 7f1aae59c640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 0x7f1a90068760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00011f0 tx=0x7f1aa0007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.168+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1aa8051bf0 con 0x7f1ab0134f90 2023-06-23T18:50:21.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ab0144b10 con 0x7f1ab0134f90 2023-06-23T18:50:21.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1a9effd640 1 -- 172.21.15.38:0/3369390206 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1aa801d020 con 0x7f1ab0134f90 2023-06-23T18:50:21.337 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:21.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 msgr2=0x7f1a90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 0x7f1a90068760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00011f0 tx=0x7f1aa0007930 comp rx=0 tx=0).stop 2023-06-23T18:50:21.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 msgr2=0x7f1ab012ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800cd50 tx=0x7f1aa800a650 comp rx=0 tx=0).stop 2023-06-23T18:50:21.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 shutdown_connections 2023-06-23T18:50:21.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1a900662b0 0x7f1a90068760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ab0134f90 0x7f1ab012ec00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ab0131d80 0x7f1ab012e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 --2- 172.21.15.38:0/3369390206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ab00712c0 0x7f1ab00b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.328+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 >> 172.21.15.38:0/3369390206 conn(0x7f1ab00c1fd0 msgr2=0x7f1ab0133cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.332+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 shutdown_connections 2023-06-23T18:50:21.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.332+0000 7f1ab4aad640 1 -- 172.21.15.38:0/3369390206 wait complete. 2023-06-23T18:50:21.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 Processor -- start 2023-06-23T18:50:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 -- start start 2023-06-23T18:50:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 0x7fce940c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce940ba7f0 0x7fce9414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce94070270 con 0x7fce9406c4b0 2023-06-23T18:50:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce941504e0 con 0x7fce940ba7f0 2023-06-23T18:50:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9bb63640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9414ff20 con 0x7fce94149980 2023-06-23T18:50:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9a100640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce940ba7f0 0x7fce9414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9a100640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fce940ba7f0 0x7fce9414bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55198/0 (socket says 172.21.15.38:55198) 2023-06-23T18:50:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.464+0000 7fce9a100640 1 -- 172.21.15.38:0/795220707 learned_addr learned my addr 172.21.15.38:0/795220707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce990fe640 1 --2- 172.21.15.38:0/795220707 >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 0x7fce940c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9a100640 1 -- 172.21.15.38:0/795220707 >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 msgr2=0x7fce940c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9a100640 1 --2- 172.21.15.38:0/795220707 >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 0x7fce940c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9a100640 1 -- 172.21.15.38:0/795220707 >> v1:172.21.15.81:6789/0 conn(0x7fce9406c4b0 legacy=0x7fce94149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:21.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9a100640 1 -- 172.21.15.38:0/795220707 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94150200 con 0x7fce940ba7f0 2023-06-23T18:50:21.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce990fe640 1 --2- 172.21.15.38:0/795220707 >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 0x7fce940c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:21.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9a100640 1 --2- 172.21.15.38:0/795220707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce940ba7f0 0x7fce9414bfa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce940738a0 tx=0x7fce8401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65fd6df22aaf14f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce988fd640 1 -- 172.21.15.38:0/795220707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840ab600 con 0x7fce940ba7f0 2023-06-23T18:50:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce988fd640 1 -- 172.21.15.38:0/795220707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840a7050 con 0x7fce940ba7f0 2023-06-23T18:50:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce988fd640 1 -- 172.21.15.38:0/795220707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840ab980 con 0x7fce940ba7f0 2023-06-23T18:50:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 -- 172.21.15.38:0/795220707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce940ba7f0 msgr2=0x7fce9414bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 --2- 172.21.15.38:0/795220707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce940ba7f0 0x7fce9414bfa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce940738a0 tx=0x7fce8401c500 comp rx=0 tx=0).stop 2023-06-23T18:50:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 -- 172.21.15.38:0/795220707 shutdown_connections 2023-06-23T18:50:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 --2- 172.21.15.38:0/795220707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce940ba7f0 0x7fce9414bfa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 --2- 172.21.15.38:0/795220707 >> v2:172.21.15.81:3300/0 conn(0x7fce94149980 0x7fce940c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 -- 172.21.15.38:0/795220707 >> 172.21.15.38:0/795220707 conn(0x7fce940bfe30 msgr2=0x7fce940c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 -- 172.21.15.38:0/795220707 shutdown_connections 2023-06-23T18:50:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.468+0000 7fce9bb63640 1 -- 172.21.15.38:0/795220707 wait complete. 2023-06-23T18:50:21.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 Processor -- start 2023-06-23T18:50:21.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- start start 2023-06-23T18:50:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 0x7fce9414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce940ba7f0 0x7fce94146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9414f910 con 0x7fce94149980 2023-06-23T18:50:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9414f5a0 con 0x7fce940ba7f0 2023-06-23T18:50:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce94146a60 con 0x7fce9406c4b0 2023-06-23T18:50:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55204/0 (socket says 172.21.15.38:55204) 2023-06-23T18:50:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 -- 172.21.15.38:0/291644578 learned_addr learned my addr 172.21.15.38:0/291644578 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce990fe640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce940ba7f0 0x7fce94146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce998ff640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 0x7fce9414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 -- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 msgr2=0x7fce9414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 0x7fce9414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 -- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce940ba7f0 msgr2=0x7fce94146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce940ba7f0 0x7fce94146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 -- 172.21.15.38:0/291644578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840094d0 con 0x7fce94149980 2023-06-23T18:50:21.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce998ff640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 0x7fce9414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:21.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9a100640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce840ae040 tx=0x7fce8401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840b6830 con 0x7fce94149980 2023-06-23T18:50:21.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840b69b0 con 0x7fce94149980 2023-06-23T18:50:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840b6d60 con 0x7fce94149980 2023-06-23T18:50:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9414e1c0 con 0x7fce94149980 2023-06-23T18:50:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9414e760 con 0x7fce94149980 2023-06-23T18:50:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9404d790 con 0x7fce94149980 2023-06-23T18:50:21.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce840b2040 con 0x7fce94149980 2023-06-23T18:50:21.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 0x7fce80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.472+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce8411e5c0 con 0x7fce94149980 2023-06-23T18:50:21.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.476+0000 7fce998ff640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 0x7fce80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.476+0000 7fce998ff640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 0x7fce80068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000f70 tx=0x7fce8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.480+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce840eb740 con 0x7fce94149980 2023-06-23T18:50:21.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.628+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fce9413ba00 con 0x7fce94149980 2023-06-23T18:50:21.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.628+0000 7fce927fc640 1 -- 172.21.15.38:0/291644578 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fce840eed60 con 0x7fce94149980 2023-06-23T18:50:21.637 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:21.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 msgr2=0x7fce80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 0x7fce80068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000f70 tx=0x7fce8c009040 comp rx=0 tx=0).stop 2023-06-23T18:50:21.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 msgr2=0x7fce94140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce840ae040 tx=0x7fce8401ad40 comp rx=0 tx=0).stop 2023-06-23T18:50:21.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 shutdown_connections 2023-06-23T18:50:21.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fce80066280 0x7fce80068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce94149980 0x7fce94140480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce940ba7f0 0x7fce94146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 --2- 172.21.15.38:0/291644578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce9406c4b0 0x7fce9414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 >> 172.21.15.38:0/291644578 conn(0x7fce940bfe30 msgr2=0x7fce940bb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 shutdown_connections 2023-06-23T18:50:21.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.632+0000 7fce9bb63640 1 -- 172.21.15.38:0/291644578 wait complete. 2023-06-23T18:50:21.655 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 Processor -- start 2023-06-23T18:50:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 -- start start 2023-06-23T18:50:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 0x7f7b6806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7b6806c9b0 0x7f7b68070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680ba9d0 con 0x7f7b680bd1e0 2023-06-23T18:50:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b680bc300 con 0x7f7b6806c9b0 2023-06-23T18:50:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b6d883640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680a5570 con 0x7f7b6814b930 2023-06-23T18:50:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b677fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7b6806c9b0 0x7f7b68070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b667fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b680bd1e0 0x7f7b68070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55440/0 (socket says 172.21.15.38:55440) 2023-06-23T18:50:21.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b667fc640 1 -- 172.21.15.38:0/3071092631 learned_addr learned my addr 172.21.15.38:0/3071092631 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:21.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 0x7f7b6806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b677fe640 1 -- 172.21.15.38:0/3071092631 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 msgr2=0x7f7b6806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:21.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b677fe640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 0x7f7b6806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b677fe640 1 -- 172.21.15.38:0/3071092631 >> v1:172.21.15.38:6789/0 conn(0x7f7b680bd1e0 legacy=0x7f7b68070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b677fe640 1 -- 172.21.15.38:0/3071092631 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68150160 con 0x7f7b6806c9b0 2023-06-23T18:50:21.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.756+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 0x7f7b6806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:21.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b677fe640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6806c9b0 0x7f7b68070970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b580097c0 tx=0x7f7b5801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15f33105cc24a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b65ffb640 1 -- 172.21.15.38:0/3071092631 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580ab610 con 0x7f7b6806c9b0 2023-06-23T18:50:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b65ffb640 1 -- 172.21.15.38:0/3071092631 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b580ab770 con 0x7f7b6806c9b0 2023-06-23T18:50:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b65ffb640 1 -- 172.21.15.38:0/3071092631 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580abb00 con 0x7f7b6806c9b0 2023-06-23T18:50:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- 172.21.15.38:0/3071092631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6806c9b0 msgr2=0x7f7b68070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6806c9b0 0x7f7b68070970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b580097c0 tx=0x7f7b5801c3f0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- 172.21.15.38:0/3071092631 shutdown_connections 2023-06-23T18:50:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6806c9b0 0x7f7b68070970 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3071092631 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6814b930 0x7f7b6806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- 172.21.15.38:0/3071092631 >> 172.21.15.38:0/3071092631 conn(0x7f7b680c0c90 msgr2=0x7f7b680bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- 172.21.15.38:0/3071092631 shutdown_connections 2023-06-23T18:50:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- 172.21.15.38:0/3071092631 wait complete. 2023-06-23T18:50:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 Processor -- start 2023-06-23T18:50:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.760+0000 7f7b6d883640 1 -- start start 2023-06-23T18:50:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6806c9b0 0x7f7b680b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 0x7f7b680b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680b95d0 con 0x7f7b6814b930 2023-06-23T18:50:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680b8230 con 0x7f7b680bd1e0 2023-06-23T18:50:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680b5ed0 con 0x7f7b6806c9b0 2023-06-23T18:50:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55224/0 (socket says 172.21.15.38:55224) 2023-06-23T18:50:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 -- 172.21.15.38:0/3587868209 learned_addr learned my addr 172.21.15.38:0/3587868209 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b667fc640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 0x7f7b680b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 -- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6806c9b0 msgr2=0x7f7b680b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6806c9b0 0x7f7b680b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6806c9b0 0x7f7b680b8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 -- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 msgr2=0x7f7b680b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 0x7f7b680b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 -- 172.21.15.38:0/3587868209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009420 con 0x7f7b6814b930 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b667fc640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 0x7f7b680b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b677fe640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7b5801a020 tx=0x7f7b5801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580b5810 con 0x7f7b6814b930 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b580b5970 con 0x7f7b6814b930 2023-06-23T18:50:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680b7150 con 0x7f7b6814b930 2023-06-23T18:50:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580b5d00 con 0x7f7b6814b930 2023-06-23T18:50:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68145570 con 0x7f7b6814b930 2023-06-23T18:50:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6804d790 con 0x7f7b6814b930 2023-06-23T18:50:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b580c83f0 con 0x7f7b6814b930 2023-06-23T18:50:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 0x7f7b48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7b5811ed00 con 0x7f7b6814b930 2023-06-23T18:50:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.764+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 0x7f7b48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.768+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 0x7f7b48068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b60008f80 tx=0x7f7b600084d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.768+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b580ebf20 con 0x7f7b6814b930 2023-06-23T18:50:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.932+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7b68066f10 con 0x7f7b6814b930 2023-06-23T18:50:21.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.932+0000 7f7b5ffff640 1 -- 172.21.15.38:0/3587868209 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7b580b5e60 con 0x7f7b6814b930 2023-06-23T18:50:21.941 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 msgr2=0x7f7b48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 0x7f7b48068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b60008f80 tx=0x7f7b600084d0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 msgr2=0x7f7b68142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7b5801a020 tx=0x7f7b5801ac30 comp rx=0 tx=0).stop 2023-06-23T18:50:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 shutdown_connections 2023-06-23T18:50:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f7b480662b0 0x7f7b48068760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b6814b930 0x7f7b68142440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b680bd1e0 0x7f7b680b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 --2- 172.21.15.38:0/3587868209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7b6806c9b0 0x7f7b680b8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:21.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 >> 172.21.15.38:0/3587868209 conn(0x7f7b680c0c90 msgr2=0x7f7b680be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:21.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 shutdown_connections 2023-06-23T18:50:21.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:21.936+0000 7f7b6d883640 1 -- 172.21.15.38:0/3587868209 wait complete. 2023-06-23T18:50:21.960 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-06-23T18:50:21.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:21.961 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-23T18:50:21.974 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[32912]: fuse finished with error 0 and tester_r 0 2023-06-23T18:50:21.975 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:50:23.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:23.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:23.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:23.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:23.267 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:28.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:50:28.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:28.078 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-23T18:50:28.085 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:50:28.085 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:28.091 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:50:28.092 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:28.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 Processor -- start 2023-06-23T18:50:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 -- start start 2023-06-23T18:50:28.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89980c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998152830 con 0x7f89980a30c0 2023-06-23T18:50:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89980c22a0 con 0x7f89980bea40 2023-06-23T18:50:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899ed7c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899806aeb0 con 0x7f89980a35f0 2023-06-23T18:50:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f8997fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f89980a30c0 0x7f899806a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57386/0 (socket says 172.21.15.38:57386) 2023-06-23T18:50:28.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f8997fff640 1 -- 172.21.15.38:0/3925358694 learned_addr learned my addr 172.21.15.38:0/3925358694 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899d319640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89980c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516927459 0 0) 0x7f8998152830 con 0x7f89980a30c0 2023-06-23T18:50:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003530 con 0x7f89980a30c0 2023-06-23T18:50:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3111177899 0 0) 0x7f8984003530 con 0x7f89980a30c0 2023-06-23T18:50:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 msgr2=0x7f89980c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89980c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 >> v1:172.21.15.81:6789/0 conn(0x7f89980bea40 legacy=0x7f899806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980c2870 con 0x7f89980a30c0 2023-06-23T18:50:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f8988001680 con 0x7f89980a30c0 2023-06-23T18:50:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 >> v1:172.21.15.38:6789/0 conn(0x7f89980a30c0 legacy=0x7f899806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89840039b0 0x7f8984003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89840047d0 0x7f8984004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89840051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899806aeb0 con 0x7f89840039b0 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898400bac0 con 0x7f89840047d0 2023-06-23T18:50:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898400bc80 con 0x7f89980a35f0 2023-06-23T18:50:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89840039b0 0x7f8984003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f8997fff640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89840047d0 0x7f8984004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899d319640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89840051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 -- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 msgr2=0x7f89840051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89980a35f0 0x7f89840051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 -- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89840047d0 msgr2=0x7f8984004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89840047d0 0x7f8984004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.263+0000 7f899cb18640 1 -- 172.21.15.38:0/3925358694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984003530 con 0x7f89840039b0 2023-06-23T18:50:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899cb18640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89840039b0 0x7f8984003dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8980001780 tx=0x7f898001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a264183a29576287 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800052d0 con 0x7f89840039b0 2023-06-23T18:50:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89800a7050 con 0x7f89840039b0 2023-06-23T18:50:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f89977fe640 1 -- 172.21.15.38:0/3925358694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980003600 con 0x7f89840039b0 2023-06-23T18:50:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- 172.21.15.38:0/3925358694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89840039b0 msgr2=0x7f8984003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 --2- 172.21.15.38:0/3925358694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89840039b0 0x7f8984003dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8980001780 tx=0x7f898001c3e0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899d319640 1 -- 172.21.15.38:0/3925358694 reap_dead start 2023-06-23T18:50:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- 172.21.15.38:0/3925358694 shutdown_connections 2023-06-23T18:50:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- 172.21.15.38:0/3925358694 >> 172.21.15.38:0/3925358694 conn(0x7f89980a5cc0 msgr2=0x7f89980a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- 172.21.15.38:0/3925358694 shutdown_connections 2023-06-23T18:50:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- 172.21.15.38:0/3925358694 wait complete. 2023-06-23T18:50:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 Processor -- start 2023-06-23T18:50:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- start start 2023-06-23T18:50:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 0x7f89980a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89980a9520 0x7f899814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8998148de0 con 0x7f8998147880 2023-06-23T18:50:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980a89c0 con 0x7f89980a9520 2023-06-23T18:50:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899ed7c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8998148230 con 0x7f89840039b0 2023-06-23T18:50:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899d319640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899d319640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54342/0 (socket says 172.21.15.38:54342) 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899d319640 1 -- 172.21.15.38:0/809311451 learned_addr learned my addr 172.21.15.38:0/809311451 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f899cb18640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 0x7f89980a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.267+0000 7f8997fff640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89980a9520 0x7f899814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 -- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 msgr2=0x7f89980a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 0x7f89980a8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 -- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89980a9520 msgr2=0x7f899814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89980a9520 0x7f899814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 -- 172.21.15.38:0/809311451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899814b6d0 con 0x7f8998147880 2023-06-23T18:50:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899cb18640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 0x7f89980a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899d319640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e90 tx=0x7f8990009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899000e070 con 0x7f8998147880 2023-06-23T18:50:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990003c70 con 0x7f8998147880 2023-06-23T18:50:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8998148ff0 con 0x7f8998147880 2023-06-23T18:50:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990003e20 con 0x7f8998147880 2023-06-23T18:50:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980a9970 con 0x7f8998147880 2023-06-23T18:50:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89980a9ea0 con 0x7f8998147880 2023-06-23T18:50:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8990004030 con 0x7f8998147880 2023-06-23T18:50:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 0x7f8978068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8990084060 con 0x7f8998147880 2023-06-23T18:50:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899cb18640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 0x7f8978068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.271+0000 7f899cb18640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 0x7f8978068760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8980001750 tx=0x7f89800011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.275+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89980a9ea0 con 0x7f8998147880 2023-06-23T18:50:28.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.431+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89980a9ea0 con 0x7f8998147880 2023-06-23T18:50:28.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.431+0000 7f89957fa640 1 -- 172.21.15.38:0/809311451 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f89980a9ea0 con 0x7f8998147880 2023-06-23T18:50:28.442 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:28.442 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:28.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 msgr2=0x7f8978068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 0x7f8978068760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8980001750 tx=0x7f89800011a0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 msgr2=0x7f8998147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e90 tx=0x7f8990009f80 comp rx=0 tx=0).stop 2023-06-23T18:50:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 shutdown_connections 2023-06-23T18:50:28.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f89780662b0 0x7f8978068760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8998147880 0x7f8998147cf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89980a9520 0x7f899814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 --2- 172.21.15.38:0/809311451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89840039b0 0x7f89980a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 >> 172.21.15.38:0/809311451 conn(0x7f89980a5cc0 msgr2=0x7f89980c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:28.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 shutdown_connections 2023-06-23T18:50:28.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.435+0000 7f899ed7c640 1 -- 172.21.15.38:0/809311451 wait complete. 2023-06-23T18:50:28.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:28.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 Processor -- start 2023-06-23T18:50:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 -- start start 2023-06-23T18:50:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feb4c0be890 0x7feb4c0c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3270 0x7feb4c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0c23a0 con 0x7feb4c0a3850 2023-06-23T18:50:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c0bf370 con 0x7feb4c0be890 2023-06-23T18:50:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb50baa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0aa080 con 0x7feb4c0a3270 2023-06-23T18:50:28.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feb4c0be890 0x7feb4c0c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feb4c0be890 0x7feb4c0c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54356/0 (socket says 172.21.15.38:54356) 2023-06-23T18:50:28.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 -- 172.21.15.38:0/3295240599 learned_addr learned my addr 172.21.15.38:0/3295240599 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:28.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb49d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feb4c0a3850 0x7feb4c0bec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57388/0 (socket says 172.21.15.38:57388) 2023-06-23T18:50:28.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4ad9d640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3270 0x7feb4c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 -- 172.21.15.38:0/3295240599 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3270 msgr2=0x7feb4c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:28.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3270 0x7feb4c151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 -- 172.21.15.38:0/3295240599 >> v1:172.21.15.38:6789/0 conn(0x7feb4c0a3850 legacy=0x7feb4c0bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4a59c640 1 -- 172.21.15.38:0/3295240599 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0bb060 con 0x7feb4c0be890 2023-06-23T18:50:28.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.579+0000 7feb4959a640 1 -- 172.21.15.38:0/3295240599 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330212688 0 0) 0x7feb4c0c23a0 con 0x7feb4c0a3850 2023-06-23T18:50:28.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0be890 0x7feb4c0c0d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009870 tx=0x7feb3c01c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70ab54143db6052 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4959a640 1 -- 172.21.15.38:0/3295240599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0ab600 con 0x7feb4c0be890 2023-06-23T18:50:28.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4959a640 1 -- 172.21.15.38:0/3295240599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0a7050 con 0x7feb4c0be890 2023-06-23T18:50:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4959a640 1 -- 172.21.15.38:0/3295240599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0ab980 con 0x7feb4c0be890 2023-06-23T18:50:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- 172.21.15.38:0/3295240599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0be890 msgr2=0x7feb4c0c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0be890 0x7feb4c0c0d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009870 tx=0x7feb3c01c160 comp rx=0 tx=0).stop 2023-06-23T18:50:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- 172.21.15.38:0/3295240599 shutdown_connections 2023-06-23T18:50:28.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3270 0x7feb4c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- 172.21.15.38:0/3295240599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0be890 0x7feb4c0c0d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- 172.21.15.38:0/3295240599 >> 172.21.15.38:0/3295240599 conn(0x7feb4c0a5d50 msgr2=0x7feb4c0a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- 172.21.15.38:0/3295240599 shutdown_connections 2023-06-23T18:50:28.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- 172.21.15.38:0/3295240599 wait complete. 2023-06-23T18:50:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 Processor -- start 2023-06-23T18:50:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- start start 2023-06-23T18:50:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3850 0x7feb4c1e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0be890 0x7feb4c148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c14f600 con 0x7feb4c0a3270 2023-06-23T18:50:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c14ef90 con 0x7feb4c0be890 2023-06-23T18:50:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb50baa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b9490 con 0x7feb4c0a3850 2023-06-23T18:50:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54370/0 (socket says 172.21.15.38:54370) 2023-06-23T18:50:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 -- 172.21.15.38:0/2112946428 learned_addr learned my addr 172.21.15.38:0/2112946428 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb49d9b640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3850 0x7feb4c1e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4ad9d640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0be890 0x7feb4c148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 -- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3850 msgr2=0x7feb4c1e9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3850 0x7feb4c1e9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 -- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0be890 msgr2=0x7feb4c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0be890 0x7feb4c148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 -- 172.21.15.38:0/2112946428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0094d0 con 0x7feb4c0a3270 2023-06-23T18:50:28.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.583+0000 7feb4a59c640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0ae040 tx=0x7feb3c01a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b6620 con 0x7feb4c0a3270 2023-06-23T18:50:28.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0b67a0 con 0x7feb4c0a3270 2023-06-23T18:50:28.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c14f220 con 0x7feb4c0a3270 2023-06-23T18:50:28.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b6b50 con 0x7feb4c0a3270 2023-06-23T18:50:28.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c0be590 con 0x7feb4c0a3270 2023-06-23T18:50:28.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c14f740 con 0x7feb4c0a3270 2023-06-23T18:50:28.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb3c0b2040 con 0x7feb4c0a3270 2023-06-23T18:50:28.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 0x7feb2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb3c11e2c0 con 0x7feb4c0a3270 2023-06-23T18:50:28.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb49d9b640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 0x7feb2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.587+0000 7feb49d9b640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 0x7feb2c068760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0be350 tx=0x7feb40007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.591+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb4c14f740 con 0x7feb4c0a3270 2023-06-23T18:50:28.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb4c14f740 con 0x7feb4c0a3270 2023-06-23T18:50:28.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb3affd640 1 -- 172.21.15.38:0/2112946428 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb4c14f740 con 0x7feb4c0a3270 2023-06-23T18:50:28.756 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 msgr2=0x7feb2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 0x7feb2c068760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0be350 tx=0x7feb40007b60 comp rx=0 tx=0).stop 2023-06-23T18:50:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 msgr2=0x7feb4c1e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0ae040 tx=0x7feb3c01a9a0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 shutdown_connections 2023-06-23T18:50:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7feb2c0662b0 0x7feb2c068760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0be890 0x7feb4c148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feb4c0a3850 0x7feb4c1e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 --2- 172.21.15.38:0/2112946428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb4c0a3270 0x7feb4c1e9680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 >> 172.21.15.38:0/2112946428 conn(0x7feb4c0a5d50 msgr2=0x7feb4c0a3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 shutdown_connections 2023-06-23T18:50:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.747+0000 7feb50baa640 1 -- 172.21.15.38:0/2112946428 wait complete. 2023-06-23T18:50:28.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 Processor -- start 2023-06-23T18:50:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 -- start start 2023-06-23T18:50:28.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf406c4b0 0x7fdcf40bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf414a860 0x7fdcf414c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf414aca0 con 0x7fdcf40bc310 2023-06-23T18:50:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf40bbf90 con 0x7fdcf406c4b0 2023-06-23T18:50:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf9d16640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf414bfe0 con 0x7fdcf414a860 2023-06-23T18:50:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf406c4b0 0x7fdcf40bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf406c4b0 0x7fdcf40bba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54374/0 (socket says 172.21.15.38:54374) 2023-06-23T18:50:28.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.887+0000 7fdcf37fe640 1 -- 172.21.15.38:0/2412715330 learned_addr learned my addr 172.21.15.38:0/2412715330 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:28.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf3fff640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf414a860 0x7fdcf414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf37fe640 1 -- 172.21.15.38:0/2412715330 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf414a860 msgr2=0x7fdcf414c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:28.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf37fe640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf414a860 0x7fdcf414c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf37fe640 1 -- 172.21.15.38:0/2412715330 >> v1:172.21.15.38:6789/0 conn(0x7fdcf40bc310 legacy=0x7fdcf414a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf37fe640 1 -- 172.21.15.38:0/2412715330 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf414ba20 con 0x7fdcf406c4b0 2023-06-23T18:50:28.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf27fc640 1 -- 172.21.15.38:0/2412715330 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936820527 0 0) 0x7fdcf414aca0 con 0x7fdcf40bc310 2023-06-23T18:50:28.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf37fe640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf406c4b0 0x7fdcf40bba50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009870 tx=0x7fdce401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb70cfe8e90321cf server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf27fc640 1 -- 172.21.15.38:0/2412715330 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40a6040 con 0x7fdcf406c4b0 2023-06-23T18:50:28.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf27fc640 1 -- 172.21.15.38:0/2412715330 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40aa600 con 0x7fdcf406c4b0 2023-06-23T18:50:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf27fc640 1 -- 172.21.15.38:0/2412715330 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40aa990 con 0x7fdcf406c4b0 2023-06-23T18:50:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 -- 172.21.15.38:0/2412715330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf406c4b0 msgr2=0x7fdcf40bba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf406c4b0 0x7fdcf40bba50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009870 tx=0x7fdce401c480 comp rx=0 tx=0).stop 2023-06-23T18:50:28.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 -- 172.21.15.38:0/2412715330 shutdown_connections 2023-06-23T18:50:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf414a860 0x7fdcf414c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/2412715330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf406c4b0 0x7fdcf40bba50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 -- 172.21.15.38:0/2412715330 >> 172.21.15.38:0/2412715330 conn(0x7fdcf40bfe30 msgr2=0x7fdcf40c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 -- 172.21.15.38:0/2412715330 shutdown_connections 2023-06-23T18:50:28.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.891+0000 7fdcf9d16640 1 -- 172.21.15.38:0/2412715330 wait complete. 2023-06-23T18:50:28.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 Processor -- start 2023-06-23T18:50:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- start start 2023-06-23T18:50:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf406c4b0 0x7fdcf40be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf414a860 0x7fdcf41e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40bea70 con 0x7fdcf40bc310 2023-06-23T18:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4146230 con 0x7fdcf414a860 2023-06-23T18:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40bb3a0 con 0x7fdcf406c4b0 2023-06-23T18:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54386/0 (socket says 172.21.15.38:54386) 2023-06-23T18:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 -- 172.21.15.38:0/48812202 learned_addr learned my addr 172.21.15.38:0/48812202 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf37fe640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf406c4b0 0x7fdcf40be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 -- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf406c4b0 msgr2=0x7fdcf40be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf406c4b0 0x7fdcf40be530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf3fff640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf414a860 0x7fdcf41e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 -- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf414a860 msgr2=0x7fdcf41e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf414a860 0x7fdcf41e6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 -- 172.21.15.38:0/48812202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40094d0 con 0x7fdcf40bc310 2023-06-23T18:50:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf2ffd640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c4d0 tx=0x7fdcdc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc005480 con 0x7fdcf40bc310 2023-06-23T18:50:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc003600 con 0x7fdcf40bc310 2023-06-23T18:50:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf41394b0 con 0x7fdcf40bc310 2023-06-23T18:50:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0039b0 con 0x7fdcf40bc310 2023-06-23T18:50:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4145ec0 con 0x7fdcf40bc310 2023-06-23T18:50:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.895+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf404d790 con 0x7fdcf40bc310 2023-06-23T18:50:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.899+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcdc003b10 con 0x7fdcf40bc310 2023-06-23T18:50:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.899+0000 7fdcebfff640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 0x7fdcd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.899+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdcdc083610 con 0x7fdcf40bc310 2023-06-23T18:50:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.899+0000 7fdcf37fe640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 0x7fdcd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.899+0000 7fdcf37fe640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 0x7fdcd4068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdce40ae000 tx=0x7fdce4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:28.903+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcdc0542f0 con 0x7fdcf40bc310 2023-06-23T18:50:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.055+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcf40c0d40 con 0x7fdcf40bc310 2023-06-23T18:50:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.055+0000 7fdcebfff640 1 -- 172.21.15.38:0/48812202 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdcdc053e80 con 0x7fdcf40bc310 2023-06-23T18:50:29.066 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 msgr2=0x7fdcd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 0x7fdcd4068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdce40ae000 tx=0x7fdce4008040 comp rx=0 tx=0).stop 2023-06-23T18:50:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 msgr2=0x7fdcf40bae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c4d0 tx=0x7fdcdc00c990 comp rx=0 tx=0).stop 2023-06-23T18:50:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 shutdown_connections 2023-06-23T18:50:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdcd4066280 0x7fdcd4068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf414a860 0x7fdcf41e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf40bc310 0x7fdcf40bae60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 --2- 172.21.15.38:0/48812202 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcf406c4b0 0x7fdcf40be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 >> 172.21.15.38:0/48812202 conn(0x7fdcf40bfe30 msgr2=0x7fdcf413e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 shutdown_connections 2023-06-23T18:50:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.059+0000 7fdcf9d16640 1 -- 172.21.15.38:0/48812202 wait complete. 2023-06-23T18:50:29.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:29.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 Processor -- start 2023-06-23T18:50:29.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 -- start start 2023-06-23T18:50:29.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f97a80ba7f0 0x7f97a80c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a8070270 con 0x7f97a8149980 2023-06-23T18:50:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a814ff20 con 0x7f97a806c4b0 2023-06-23T18:50:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97aff48640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a81504e0 con 0x7f97a80ba7f0 2023-06-23T18:50:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ae4e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f97a80ba7f0 0x7f97a80c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ad4e3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f97a8149980 0x7f97a8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57400/0 (socket says 172.21.15.38:57400) 2023-06-23T18:50:29.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ad4e3640 1 -- 172.21.15.38:0/2041280093 learned_addr learned my addr 172.21.15.38:0/2041280093 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:29.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ae4e5640 1 -- 172.21.15.38:0/2041280093 >> v1:172.21.15.81:6789/0 conn(0x7f97a806c4b0 legacy=0x7f97a8149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:29.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ae4e5640 1 -- 172.21.15.38:0/2041280093 >> v1:172.21.15.38:6789/0 conn(0x7f97a8149980 legacy=0x7f97a8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97ae4e5640 1 -- 172.21.15.38:0/2041280093 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8150200 con 0x7f97a80ba7f0 2023-06-23T18:50:29.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.207+0000 7f97acce2640 1 -- 172.21.15.38:0/2041280093 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78037310 0 0) 0x7f97a8070270 con 0x7f97a8149980 2023-06-23T18:50:29.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97ae4e5640 1 --2- 172.21.15.38:0/2041280093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a80c09d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097c0 tx=0x7f97a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295e1b631d384159 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97acce2640 1 -- 172.21.15.38:0/2041280093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0004230 con 0x7f97a80ba7f0 2023-06-23T18:50:29.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97acce2640 1 -- 172.21.15.38:0/2041280093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00a7050 con 0x7f97a80ba7f0 2023-06-23T18:50:29.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97acce2640 1 -- 172.21.15.38:0/2041280093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0003620 con 0x7f97a80ba7f0 2023-06-23T18:50:29.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- 172.21.15.38:0/2041280093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 msgr2=0x7f97a80c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 --2- 172.21.15.38:0/2041280093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a80c09d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097c0 tx=0x7f97a001c440 comp rx=0 tx=0).stop 2023-06-23T18:50:29.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- 172.21.15.38:0/2041280093 shutdown_connections 2023-06-23T18:50:29.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 --2- 172.21.15.38:0/2041280093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a80c09d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- 172.21.15.38:0/2041280093 >> 172.21.15.38:0/2041280093 conn(0x7f97a80bfe30 msgr2=0x7f97a80c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- 172.21.15.38:0/2041280093 shutdown_connections 2023-06-23T18:50:29.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- 172.21.15.38:0/2041280093 wait complete. 2023-06-23T18:50:29.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 Processor -- start 2023-06-23T18:50:29.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.211+0000 7f97aff48640 1 -- start start 2023-06-23T18:50:29.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 0x7f97a813a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a8149980 0x7f97a813da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81e8440 con 0x7f97a80ba7f0 2023-06-23T18:50:29.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81e86e0 con 0x7f97a8149980 2023-06-23T18:50:29.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a813ac70 con 0x7f97a806c4b0 2023-06-23T18:50:29.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54410/0 (socket says 172.21.15.38:54410) 2023-06-23T18:50:29.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 -- 172.21.15.38:0/1297925154 learned_addr learned my addr 172.21.15.38:0/1297925154 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:29.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ae4e5640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a8149980 0x7f97a813da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97adce4640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 0x7f97a813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 -- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 msgr2=0x7f97a813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 0x7f97a813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 -- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a8149980 msgr2=0x7f97a813da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a8149980 0x7f97a813da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 -- 172.21.15.38:0/1297925154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009420 con 0x7f97a80ba7f0 2023-06-23T18:50:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97adce4640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 0x7f97a813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97ad4e3640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c890 tx=0x7f97a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400a640 con 0x7f97a80ba7f0 2023-06-23T18:50:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a400a7c0 con 0x7f97a80ba7f0 2023-06-23T18:50:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400ab70 con 0x7f97a80ba7f0 2023-06-23T18:50:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a814d4c0 con 0x7f97a80ba7f0 2023-06-23T18:50:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a8137790 con 0x7f97a80ba7f0 2023-06-23T18:50:29.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a81e8890 con 0x7f97a80ba7f0 2023-06-23T18:50:29.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97a400acd0 con 0x7f97a80ba7f0 2023-06-23T18:50:29.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97a40834f0 con 0x7f97a80ba7f0 2023-06-23T18:50:29.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.215+0000 7f97adce4640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.219+0000 7f97adce4640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 0x7f978c068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f97a814e440 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.219+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97a81e8890 con 0x7f97a80ba7f0 2023-06-23T18:50:29.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97a81e8850 con 0x7f97a80ba7f0 2023-06-23T18:50:29.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f979a7fc640 1 -- 172.21.15.38:0/1297925154 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97a4050710 con 0x7f97a80ba7f0 2023-06-23T18:50:29.388 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:29.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 msgr2=0x7f978c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 0x7f978c068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f97a814e440 tx=0x7f979c008040 comp rx=0 tx=0).stop 2023-06-23T18:50:29.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 msgr2=0x7f97a813d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c890 tx=0x7f97a400cd50 comp rx=0 tx=0).stop 2023-06-23T18:50:29.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 shutdown_connections 2023-06-23T18:50:29.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f978c066280 0x7f978c068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a8149980 0x7f97a813da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97a80ba7f0 0x7f97a813d4e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 --2- 172.21.15.38:0/1297925154 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97a806c4b0 0x7f97a813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 >> 172.21.15.38:0/1297925154 conn(0x7f97a80bfe30 msgr2=0x7f97a814c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 shutdown_connections 2023-06-23T18:50:29.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.379+0000 7f97aff48640 1 -- 172.21.15.38:0/1297925154 wait complete. 2023-06-23T18:50:29.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:29.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 Processor -- start 2023-06-23T18:50:29.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 -- start start 2023-06-23T18:50:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe108137320 0x7fe1080b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1080bb920 0x7fe10806c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1080bbed0 con 0x7fe10806c790 2023-06-23T18:50:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080b9350 con 0x7fe1080bb920 2023-06-23T18:50:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe10dfa2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080b9630 con 0x7fe108137320 2023-06-23T18:50:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1080bb920 0x7fe10806c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1080bb920 0x7fe10806c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54416/0 (socket says 172.21.15.38:54416) 2023-06-23T18:50:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 -- 172.21.15.38:0/3186938540 learned_addr learned my addr 172.21.15.38:0/3186938540 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe1077fe640 1 --2- 172.21.15.38:0/3186938540 >> v2:172.21.15.81:3300/0 conn(0x7fe108137320 0x7fe1080b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 -- 172.21.15.38:0/3186938540 >> v2:172.21.15.81:3300/0 conn(0x7fe108137320 msgr2=0x7fe1080b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 --2- 172.21.15.38:0/3186938540 >> v2:172.21.15.81:3300/0 conn(0x7fe108137320 0x7fe1080b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 -- 172.21.15.38:0/3186938540 >> v1:172.21.15.81:6789/0 conn(0x7fe10806c790 legacy=0x7fe10814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:29.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.523+0000 7fe106ffd640 1 -- 172.21.15.38:0/3186938540 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1081376f0 con 0x7fe1080bb920 2023-06-23T18:50:29.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 --2- 172.21.15.38:0/3186938540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe10806c250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe10806dc30 tx=0x7fe0fc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ef49e55ffddf18 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe1067fc640 1 -- 172.21.15.38:0/3186938540 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0ab600 con 0x7fe1080bb920 2023-06-23T18:50:29.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe1067fc640 1 -- 172.21.15.38:0/3186938540 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0a7050 con 0x7fe1080bb920 2023-06-23T18:50:29.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe1067fc640 1 -- 172.21.15.38:0/3186938540 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0ab980 con 0x7fe1080bb920 2023-06-23T18:50:29.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- 172.21.15.38:0/3186938540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 msgr2=0x7fe10806c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/3186938540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe10806c250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe10806dc30 tx=0x7fe0fc01c3e0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- 172.21.15.38:0/3186938540 shutdown_connections 2023-06-23T18:50:29.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/3186938540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe10806c250 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/3186938540 >> v2:172.21.15.81:3300/0 conn(0x7fe108137320 0x7fe1080b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- 172.21.15.38:0/3186938540 >> 172.21.15.38:0/3186938540 conn(0x7fe1080bfe30 msgr2=0x7fe1080c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- 172.21.15.38:0/3186938540 shutdown_connections 2023-06-23T18:50:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- 172.21.15.38:0/3186938540 wait complete. 2023-06-23T18:50:29.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 Processor -- start 2023-06-23T18:50:29.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- start start 2023-06-23T18:50:29.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe10806c790 0x7fe10814d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe108137320 0x7fe10814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10814dda0 con 0x7fe1080bb920 2023-06-23T18:50:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe108145fb0 con 0x7fe108137320 2023-06-23T18:50:29.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe10dfa2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10814c400 con 0x7fe10806c790 2023-06-23T18:50:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54430/0 (socket says 172.21.15.38:54430) 2023-06-23T18:50:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 -- 172.21.15.38:0/2209333966 learned_addr learned my addr 172.21.15.38:0/2209333966 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe107fff640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe108137320 0x7fe10814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe1077fe640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe10806c790 0x7fe10814d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 -- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe10806c790 msgr2=0x7fe10814d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe10806c790 0x7fe10814d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 -- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe108137320 msgr2=0x7fe10814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe108137320 0x7fe10814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.527+0000 7fe106ffd640 1 -- 172.21.15.38:0/2209333966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0094d0 con 0x7fe1080bb920 2023-06-23T18:50:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe106ffd640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc018ff0 tx=0x7fe0fc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0b37d0 con 0x7fe1080bb920 2023-06-23T18:50:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0b3930 con 0x7fe1080bb920 2023-06-23T18:50:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0b3ca0 con 0x7fe1080bb920 2023-06-23T18:50:29.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe108158170 con 0x7fe1080bb920 2023-06-23T18:50:29.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1081461c0 con 0x7fe1080bb920 2023-06-23T18:50:29.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10804d790 con 0x7fe1080bb920 2023-06-23T18:50:29.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0fc0b2070 con 0x7fe1080bb920 2023-06-23T18:50:29.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe0fc11e360 con 0x7fe1080bb920 2023-06-23T18:50:29.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe1077fe640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.531+0000 7fe1077fe640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 0x7fe0f4068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800b9b0 tx=0x7fe0f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.535+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0fc0eb4f0 con 0x7fe1080bb920 2023-06-23T18:50:29.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe108136700 con 0x7fe1080bb920 2023-06-23T18:50:29.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe0effff640 1 -- 172.21.15.38:0/2209333966 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0fc0eeb10 con 0x7fe1080bb920 2023-06-23T18:50:29.696 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:29.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 msgr2=0x7fe0f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 0x7fe0f4068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800b9b0 tx=0x7fe0f8008040 comp rx=0 tx=0).stop 2023-06-23T18:50:29.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 msgr2=0x7fe108157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc018ff0 tx=0x7fe0fc019180 comp rx=0 tx=0).stop 2023-06-23T18:50:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 shutdown_connections 2023-06-23T18:50:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe108137320 0x7fe10814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1080bb920 0x7fe108157c30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 --2- 172.21.15.38:0/2209333966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe10806c790 0x7fe10814d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 >> 172.21.15.38:0/2209333966 conn(0x7fe1080bfe30 msgr2=0x7fe108146540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 shutdown_connections 2023-06-23T18:50:29.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.687+0000 7fe10dfa2640 1 -- 172.21.15.38:0/2209333966 wait complete. 2023-06-23T18:50:29.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:29.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 Processor -- start 2023-06-23T18:50:29.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 -- start start 2023-06-23T18:50:29.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab6c0be890 0x7fab6c0c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab6c0a3270 0x7fab6c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0c23a0 con 0x7fab6c0a3850 2023-06-23T18:50:29.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0bf370 con 0x7fab6c0be890 2023-06-23T18:50:29.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab73743640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0aa080 con 0x7fab6c0a3270 2023-06-23T18:50:29.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab6c0be890 0x7fab6c0c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab6c0be890 0x7fab6c0c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54442/0 (socket says 172.21.15.38:54442) 2023-06-23T18:50:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 -- 172.21.15.38:0/4205175213 learned_addr learned my addr 172.21.15.38:0/4205175213 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab71ce0640 1 --2- 172.21.15.38:0/4205175213 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0a3270 0x7fab6c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 -- 172.21.15.38:0/4205175213 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0a3270 msgr2=0x7fab6c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 --2- 172.21.15.38:0/4205175213 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0a3270 0x7fab6c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 -- 172.21.15.38:0/4205175213 >> v1:172.21.15.81:6789/0 conn(0x7fab6c0a3850 legacy=0x7fab6c0bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.827+0000 7fab714df640 1 -- 172.21.15.38:0/4205175213 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0bb060 con 0x7fab6c0be890 2023-06-23T18:50:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- 172.21.15.38:0/4205175213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0be890 0x7fab6c0c0d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fab68009870 tx=0x7fab6801c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789a0190ab536ade server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab63fff640 1 -- 172.21.15.38:0/4205175213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680ab600 con 0x7fab6c0be890 2023-06-23T18:50:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab63fff640 1 -- 172.21.15.38:0/4205175213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab680a7050 con 0x7fab6c0be890 2023-06-23T18:50:29.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab63fff640 1 -- 172.21.15.38:0/4205175213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680ab980 con 0x7fab6c0be890 2023-06-23T18:50:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/4205175213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0be890 msgr2=0x7fab6c0c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- 172.21.15.38:0/4205175213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0be890 0x7fab6c0c0d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fab68009870 tx=0x7fab6801c0e0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/4205175213 shutdown_connections 2023-06-23T18:50:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- 172.21.15.38:0/4205175213 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0a3270 0x7fab6c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- 172.21.15.38:0/4205175213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0be890 0x7fab6c0c0d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/4205175213 >> 172.21.15.38:0/4205175213 conn(0x7fab6c0a5d50 msgr2=0x7fab6c0a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/4205175213 shutdown_connections 2023-06-23T18:50:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/4205175213 wait complete. 2023-06-23T18:50:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 Processor -- start 2023-06-23T18:50:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- start start 2023-06-23T18:50:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c0a3850 0x7fab6c0bb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c0be890 0x7fab6c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0bd010 con 0x7fab6c0a3270 2023-06-23T18:50:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1e6d20 con 0x7fab6c0a3850 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0bbbb0 con 0x7fab6c0be890 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54444/0 (socket says 172.21.15.38:54444) 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 -- 172.21.15.38:0/1765395807 learned_addr learned my addr 172.21.15.38:0/1765395807 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab70cde640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c0a3850 0x7fab6c0bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab71ce0640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c0be890 0x7fab6c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 -- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c0be890 msgr2=0x7fab6c14ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c0be890 0x7fab6c14ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 -- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c0a3850 msgr2=0x7fab6c0bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c0a3850 0x7fab6c0bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 -- 172.21.15.38:0/1765395807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680094d0 con 0x7fab6c0a3270 2023-06-23T18:50:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab714df640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fab680ae040 tx=0x7fab6801a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680b6620 con 0x7fab6c0a3270 2023-06-23T18:50:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab680b67a0 con 0x7fab6c0a3270 2023-06-23T18:50:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c1e66d0 con 0x7fab6c0a3270 2023-06-23T18:50:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680b6b50 con 0x7fab6c0a3270 2023-06-23T18:50:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.831+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c14cbf0 con 0x7fab6c0a3270 2023-06-23T18:50:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c04d790 con 0x7fab6c0a3270 2023-06-23T18:50:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab680b2040 con 0x7fab6c0a3270 2023-06-23T18:50:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab61ffb640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 0x7fab50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab6811e7f0 con 0x7fab6c0a3270 2023-06-23T18:50:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab70cde640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 0x7fab50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.835+0000 7fab70cde640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 0x7fab50068760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007fd0 tx=0x7fab5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:29.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.839+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab680ebb10 con 0x7fab6c0a3270 2023-06-23T18:50:29.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.983+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fab6c0a9890 con 0x7fab6c0a3270 2023-06-23T18:50:29.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.983+0000 7fab61ffb640 1 -- 172.21.15.38:0/1765395807 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fab680ef130 con 0x7fab6c0a3270 2023-06-23T18:50:29.994 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:29.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 msgr2=0x7fab50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 0x7fab50068760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007fd0 tx=0x7fab5c009040 comp rx=0 tx=0).stop 2023-06-23T18:50:29.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 msgr2=0x7fab6c0bbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:29.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fab680ae040 tx=0x7fab6801a920 comp rx=0 tx=0).stop 2023-06-23T18:50:29.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 shutdown_connections 2023-06-23T18:50:29.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fab500662b0 0x7fab50068760 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c0be890 0x7fab6c14ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c0a3850 0x7fab6c0bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 --2- 172.21.15.38:0/1765395807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab6c0a3270 0x7fab6c0bbf20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:29.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 >> 172.21.15.38:0/1765395807 conn(0x7fab6c0a5d50 msgr2=0x7fab6c0a4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:29.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 shutdown_connections 2023-06-23T18:50:29.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:29.987+0000 7fab73743640 1 -- 172.21.15.38:0/1765395807 wait complete. 2023-06-23T18:50:30.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:30.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 Processor -- start 2023-06-23T18:50:30.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 -- start start 2023-06-23T18:50:30.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb1814b7d0 0x7fdb1814bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb180bb2f0 0x7fdb1806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb180713f0 con 0x7fdb1806eba0 2023-06-23T18:50:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb180bbc50 con 0x7fdb1814b7d0 2023-06-23T18:50:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1e6a4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1814c4a0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb1814b7d0 0x7fdb1814bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1cc41640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdb1806eba0 0x7fdb180bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57416/0 (socket says 172.21.15.38:57416) 2023-06-23T18:50:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb1814b7d0 0x7fdb1814bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54454/0 (socket says 172.21.15.38:54454) 2023-06-23T18:50:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb1cc41640 1 -- 172.21.15.38:0/1588106156 learned_addr learned my addr 172.21.15.38:0/1588106156 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb177fe640 1 --2- 172.21.15.38:0/1588106156 >> v2:172.21.15.81:3300/0 conn(0x7fdb180bb2f0 0x7fdb1806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 -- 172.21.15.38:0/1588106156 >> v2:172.21.15.81:3300/0 conn(0x7fdb180bb2f0 msgr2=0x7fdb1806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 --2- 172.21.15.38:0/1588106156 >> v2:172.21.15.81:3300/0 conn(0x7fdb180bb2f0 0x7fdb1806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 -- 172.21.15.38:0/1588106156 >> v1:172.21.15.38:6789/0 conn(0x7fdb1806eba0 legacy=0x7fdb180bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb17fff640 1 -- 172.21.15.38:0/1588106156 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18071110 con 0x7fdb1814b7d0 2023-06-23T18:50:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.127+0000 7fdb16ffd640 1 -- 172.21.15.38:0/1588106156 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834761018 0 0) 0x7fdb100014a0 con 0x7fdb1806eba0 2023-06-23T18:50:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb17fff640 1 --2- 172.21.15.38:0/1588106156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb1814b7d0 0x7fdb1814bba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdb1806e110 tx=0x7fdb0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933efbf44b2554c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb16ffd640 1 -- 172.21.15.38:0/1588106156 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080ab600 con 0x7fdb1814b7d0 2023-06-23T18:50:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb16ffd640 1 -- 172.21.15.38:0/1588106156 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a7050 con 0x7fdb1814b7d0 2023-06-23T18:50:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb16ffd640 1 -- 172.21.15.38:0/1588106156 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080ab980 con 0x7fdb1814b7d0 2023-06-23T18:50:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/1588106156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb1814b7d0 msgr2=0x7fdb1814bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/1588106156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb1814b7d0 0x7fdb1814bba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdb1806e110 tx=0x7fdb0801c460 comp rx=0 tx=0).stop 2023-06-23T18:50:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/1588106156 shutdown_connections 2023-06-23T18:50:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/1588106156 >> v2:172.21.15.81:3300/0 conn(0x7fdb180bb2f0 0x7fdb1806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/1588106156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb1814b7d0 0x7fdb1814bba0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/1588106156 >> 172.21.15.38:0/1588106156 conn(0x7fdb180bd1b0 msgr2=0x7fdb180bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/1588106156 shutdown_connections 2023-06-23T18:50:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/1588106156 wait complete. 2023-06-23T18:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 Processor -- start 2023-06-23T18:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 -- start start 2023-06-23T18:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb1806eba0 0x7fdb180b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.131+0000 7fdb1e6a4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb1814b7d0 0x7fdb1814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181502c0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180b6f80 con 0x7fdb1806eba0 2023-06-23T18:50:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180b7200 con 0x7fdb1814b7d0 2023-06-23T18:50:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54458/0 (socket says 172.21.15.38:54458) 2023-06-23T18:50:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 -- 172.21.15.38:0/2995865201 learned_addr learned my addr 172.21.15.38:0/2995865201 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 -- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb1814b7d0 msgr2=0x7fdb1814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb1814b7d0 0x7fdb1814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 -- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb1806eba0 msgr2=0x7fdb180b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb1806eba0 0x7fdb180b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 -- 172.21.15.38:0/2995865201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08009420 con 0x7fdb180bb2f0 2023-06-23T18:50:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb177fe640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d800 tx=0x7fdb0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00b6c0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00b860 con 0x7fdb180bb2f0 2023-06-23T18:50:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00bc10 con 0x7fdb180bb2f0 2023-06-23T18:50:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180b74a0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb180b57f0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1804d790 con 0x7fdb180bb2f0 2023-06-23T18:50:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb0c01e460 con 0x7fdb180bb2f0 2023-06-23T18:50:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 0x7fdb04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb0c084590 con 0x7fdb180bb2f0 2023-06-23T18:50:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.135+0000 7fdb17fff640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 0x7fdb04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.139+0000 7fdb17fff640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 0x7fdb04068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ad000 tx=0x7fdb08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.139+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb0c0517b0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb180c0510 con 0x7fdb180bb2f0 2023-06-23T18:50:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb14ff9640 1 -- 172.21.15.38:0/2995865201 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdb0c054dd0 con 0x7fdb180bb2f0 2023-06-23T18:50:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:30.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 msgr2=0x7fdb04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 0x7fdb04068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb080ad000 tx=0x7fdb08008040 comp rx=0 tx=0).stop 2023-06-23T18:50:30.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 msgr2=0x7fdb181e5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d800 tx=0x7fdb0c00dcc0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 shutdown_connections 2023-06-23T18:50:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdb04066280 0x7fdb04068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb1814b7d0 0x7fdb1814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb180bb2f0 0x7fdb181e5f40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 --2- 172.21.15.38:0/2995865201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb1806eba0 0x7fdb180b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 >> 172.21.15.38:0/2995865201 conn(0x7fdb180bd1b0 msgr2=0x7fdb18069470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 shutdown_connections 2023-06-23T18:50:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.307+0000 7fdb1e6a4640 1 -- 172.21.15.38:0/2995865201 wait complete. 2023-06-23T18:50:30.334 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2023-06-23T18:50:30.335 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:30.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:30.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.443+0000 7fb85d59b640 1 Processor -- start 2023-06-23T18:50:30.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.443+0000 7fb85d59b640 1 -- start start 2023-06-23T18:50:30.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb8580a30c0 0x7fb8580c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb858152830 con 0x7fb8580bee10 2023-06-23T18:50:30.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580c22a0 con 0x7fb8580a30c0 2023-06-23T18:50:30.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c2870 con 0x7fb8580bea40 2023-06-23T18:50:30.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb8580a30c0 0x7fb8580c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb8577fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8580bee10 0x7fb85806a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57422/0 (socket says 172.21.15.38:57422) 2023-06-23T18:50:30.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb8577fe640 1 -- 172.21.15.38:0/2984503728 learned_addr learned my addr 172.21.15.38:0/2984503728 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:30.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 -- 172.21.15.38:0/2984503728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 msgr2=0x7fb8580a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:30.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 --2- 172.21.15.38:0/2984503728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 -- 172.21.15.38:0/2984503728 >> v1:172.21.15.38:6789/0 conn(0x7fb8580bee10 legacy=0x7fb85806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 -- 172.21.15.38:0/2984503728 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580b7950 con 0x7fb8580a30c0 2023-06-23T18:50:30.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb84ffff640 1 --2- 172.21.15.38:0/2984503728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580c0c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097c0 tx=0x7fb84001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf00fb14d6c7b7e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb8567fc640 1 -- 172.21.15.38:0/2984503728 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400ab600 con 0x7fb8580a30c0 2023-06-23T18:50:30.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb8567fc640 1 -- 172.21.15.38:0/2984503728 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400a7050 con 0x7fb8580a30c0 2023-06-23T18:50:30.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb8567fc640 1 -- 172.21.15.38:0/2984503728 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400ab980 con 0x7fb8580a30c0 2023-06-23T18:50:30.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- 172.21.15.38:0/2984503728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 msgr2=0x7fb8580c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 --2- 172.21.15.38:0/2984503728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580c0c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097c0 tx=0x7fb84001c3f0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- 172.21.15.38:0/2984503728 shutdown_connections 2023-06-23T18:50:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 --2- 172.21.15.38:0/2984503728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580c0c70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 --2- 172.21.15.38:0/2984503728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- 172.21.15.38:0/2984503728 >> 172.21.15.38:0/2984503728 conn(0x7fb8580a5cc0 msgr2=0x7fb8580a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- 172.21.15.38:0/2984503728 shutdown_connections 2023-06-23T18:50:30.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.447+0000 7fb85d59b640 1 -- 172.21.15.38:0/2984503728 wait complete. 2023-06-23T18:50:30.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 Processor -- start 2023-06-23T18:50:30.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- start start 2023-06-23T18:50:30.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 0x7fb8581e9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85814a5b0 con 0x7fb8580a30c0 2023-06-23T18:50:30.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8581e9bb0 con 0x7fb8580bee10 2023-06-23T18:50:30.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8581e9e30 con 0x7fb8580bea40 2023-06-23T18:50:30.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54474/0 (socket says 172.21.15.38:54474) 2023-06-23T18:50:30.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 -- 172.21.15.38:0/756860217 learned_addr learned my addr 172.21.15.38:0/756860217 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:30.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb8577fe640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 0x7fb8581e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84ffff640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 -- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 msgr2=0x7fb8580a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 -- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 msgr2=0x7fb8581e9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 0x7fb8581e9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 -- 172.21.15.38:0/756860217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009420 con 0x7fb8580a30c0 2023-06-23T18:50:30.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb8577fe640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 0x7fb8581e9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:30.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb856ffd640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b550 tx=0x7fb84800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848010870 con 0x7fb8580a30c0 2023-06-23T18:50:30.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8480109f0 con 0x7fb8580a30c0 2023-06-23T18:50:30.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8581ea110 con 0x7fb8580a30c0 2023-06-23T18:50:30.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848010da0 con 0x7fb8580a30c0 2023-06-23T18:50:30.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580a75e0 con 0x7fb8580a30c0 2023-06-23T18:50:30.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85804d790 con 0x7fb8580a30c0 2023-06-23T18:50:30.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb84800f3c0 con 0x7fb8580a30c0 2023-06-23T18:50:30.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 0x7fb838068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.451+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb848084020 con 0x7fb8580a30c0 2023-06-23T18:50:30.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.455+0000 7fb84ffff640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 0x7fb838068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.455+0000 7fb84ffff640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 0x7fb838068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb8400ad000 tx=0x7fb840008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.455+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb848051240 con 0x7fb8580a30c0 2023-06-23T18:50:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.607+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8581ea2a0 con 0x7fb8580a30c0 2023-06-23T18:50:30.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb84f7fe640 1 -- 172.21.15.38:0/756860217 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fb848054860 con 0x7fb8580a30c0 2023-06-23T18:50:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:30.621 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:30.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 msgr2=0x7fb838068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 0x7fb838068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb8400ad000 tx=0x7fb840008040 comp rx=0 tx=0).stop 2023-06-23T18:50:30.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 msgr2=0x7fb8580b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b550 tx=0x7fb84800ba10 comp rx=0 tx=0).stop 2023-06-23T18:50:30.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 shutdown_connections 2023-06-23T18:50:30.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb838066280 0x7fb838068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580bee10 0x7fb8581e9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb8580bea40 0x7fb8580a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 --2- 172.21.15.38:0/756860217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8580a30c0 0x7fb8580b7030 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 >> 172.21.15.38:0/756860217 conn(0x7fb8580a5cc0 msgr2=0x7fb858146b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 shutdown_connections 2023-06-23T18:50:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.611+0000 7fb85d59b640 1 -- 172.21.15.38:0/756860217 wait complete. 2023-06-23T18:50:30.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:30.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:30.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.751+0000 7f6b76ed7640 1 Processor -- start 2023-06-23T18:50:30.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.751+0000 7f6b76ed7640 1 -- start start 2023-06-23T18:50:30.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b76ed7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 0x7f6b700c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b76ed7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b70070270 con 0x7f6b70149980 2023-06-23T18:50:30.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b76ed7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7014ff20 con 0x7f6b7006c4b0 2023-06-23T18:50:30.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b76ed7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701504e0 con 0x7f6b700ba7f0 2023-06-23T18:50:30.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6b70149980 0x7f6b70070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57428/0 (socket says 172.21.15.38:57428) 2023-06-23T18:50:30.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6ffff640 1 -- 172.21.15.38:0/3958363702 learned_addr learned my addr 172.21.15.38:0/3958363702 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b75474640 1 --2- 172.21.15.38:0/3958363702 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 0x7f6b700c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805514097 0 0) 0x7f6b70070270 con 0x7f6b70149980 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b58003530 con 0x7f6b70149980 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158015654 0 0) 0x7f6b7014ff20 con 0x7f6b7006c4b0 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70070270 con 0x7f6b7006c4b0 2023-06-23T18:50:30.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b75474640 1 -- 172.21.15.38:0/3958363702 >> v1:172.21.15.81:6789/0 conn(0x7f6b7006c4b0 legacy=0x7f6b70149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b75474640 1 -- 172.21.15.38:0/3958363702 >> v1:172.21.15.38:6789/0 conn(0x7f6b70149980 legacy=0x7f6b70070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.755+0000 7f6b75474640 1 -- 172.21.15.38:0/3958363702 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70150200 con 0x7f6b700ba7f0 2023-06-23T18:50:30.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b75474640 1 --2- 172.21.15.38:0/3958363702 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 0x7f6b700c09d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009dc0 tx=0x7f6b6801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e058c5b4c6d83bef server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a5940 con 0x7f6b700ba7f0 2023-06-23T18:50:30.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680a5aa0 con 0x7f6b700ba7f0 2023-06-23T18:50:30.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6f7fe640 1 -- 172.21.15.38:0/3958363702 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a5e10 con 0x7f6b700ba7f0 2023-06-23T18:50:30.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/3958363702 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 msgr2=0x7f6b700c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/3958363702 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 0x7f6b700c09d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009dc0 tx=0x7f6b6801c970 comp rx=0 tx=0).stop 2023-06-23T18:50:30.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/3958363702 shutdown_connections 2023-06-23T18:50:30.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/3958363702 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b700ba7f0 0x7f6b700c09d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/3958363702 >> 172.21.15.38:0/3958363702 conn(0x7f6b700bfe30 msgr2=0x7f6b700c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/3958363702 shutdown_connections 2023-06-23T18:50:30.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/3958363702 wait complete. 2023-06-23T18:50:30.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 Processor -- start 2023-06-23T18:50:30.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- start start 2023-06-23T18:50:30.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b7006c4b0 0x7f6b701e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70149980 0x7f6b7014e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7013dd60 con 0x7f6b700ba7f0 2023-06-23T18:50:30.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700ba2a0 con 0x7f6b70149980 2023-06-23T18:50:30.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7014d770 con 0x7f6b7006c4b0 2023-06-23T18:50:30.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54482/0 (socket says 172.21.15.38:54482) 2023-06-23T18:50:30.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 -- 172.21.15.38:0/2417201672 learned_addr learned my addr 172.21.15.38:0/2417201672 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:30.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b74c73640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b7006c4b0 0x7f6b701e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b75474640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70149980 0x7f6b7014e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 -- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b7006c4b0 msgr2=0x7f6b701e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b7006c4b0 0x7f6b701e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 -- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70149980 msgr2=0x7f6b7014e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70149980 0x7f6b7014e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 -- 172.21.15.38:0/2417201672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009a70 con 0x7f6b700ba7f0 2023-06-23T18:50:30.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6ffff640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c420 tx=0x7f6b6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005cf0 con 0x7f6b700ba7f0 2023-06-23T18:50:30.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64005e50 con 0x7f6b700ba7f0 2023-06-23T18:50:30.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7014d490 con 0x7f6b700ba7f0 2023-06-23T18:50:30.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64007310 con 0x7f6b700ba7f0 2023-06-23T18:50:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.759+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7014e920 con 0x7f6b700ba7f0 2023-06-23T18:50:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7004d790 con 0x7f6b700ba7f0 2023-06-23T18:50:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b64007470 con 0x7f6b700ba7f0 2023-06-23T18:50:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b6d7fa640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 0x7f6b5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:30.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6b64083590 con 0x7f6b700ba7f0 2023-06-23T18:50:30.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b74c73640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 0x7f6b5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:30.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.763+0000 7f6b74c73640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 0x7f6b5c068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b600011f0 tx=0x7f6b60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:30.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.767+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b640507d0 con 0x7f6b700ba7f0 2023-06-23T18:50:30.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b7014b290 con 0x7f6b700ba7f0 2023-06-23T18:50:30.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b6d7fa640 1 -- 172.21.15.38:0/2417201672 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b64053df0 con 0x7f6b700ba7f0 2023-06-23T18:50:30.928 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 msgr2=0x7f6b5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 0x7f6b5c068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b600011f0 tx=0x7f6b60009040 comp rx=0 tx=0).stop 2023-06-23T18:50:30.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 msgr2=0x7f6b700b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c420 tx=0x7f6b6400c8e0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 shutdown_connections 2023-06-23T18:50:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6b5c066280 0x7f6b5c068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70149980 0x7f6b7014e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b700ba7f0 0x7f6b700b9d60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 --2- 172.21.15.38:0/2417201672 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b7006c4b0 0x7f6b701e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 >> 172.21.15.38:0/2417201672 conn(0x7f6b700bfe30 msgr2=0x7f6b70149f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 shutdown_connections 2023-06-23T18:50:30.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:30.919+0000 7f6b76ed7640 1 -- 172.21.15.38:0/2417201672 wait complete. 2023-06-23T18:50:30.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:31.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 Processor -- start 2023-06-23T18:50:31.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 -- start start 2023-06-23T18:50:31.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 0x7f147c0bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c14aca0 con 0x7f147c0bc310 2023-06-23T18:50:31.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c14bfe0 con 0x7f147c06c4b0 2023-06-23T18:50:31.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1482622640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0bbf90 con 0x7f147c14a860 2023-06-23T18:50:31.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f147b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f147c0bc310 0x7f147c14c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57442/0 (socket says 172.21.15.38:57442) 2023-06-23T18:50:31.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f147b7fe640 1 -- 172.21.15.38:0/3202748589 learned_addr learned my addr 172.21.15.38:0/3202748589 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:31.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f1480bbf640 1 --2- 172.21.15.38:0/3202748589 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 0x7f147c0bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207627445 0 0) 0x7f147c14aca0 con 0x7f147c0bc310 2023-06-23T18:50:31.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.067+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464005740 con 0x7f147c0bc310 2023-06-23T18:50:31.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569082624 0 0) 0x7f147c14bfe0 con 0x7f147c06c4b0 2023-06-23T18:50:31.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147c14aca0 con 0x7f147c06c4b0 2023-06-23T18:50:31.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1480bbf640 1 -- 172.21.15.38:0/3202748589 >> v1:172.21.15.81:6789/0 conn(0x7f147c06c4b0 legacy=0x7f147c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1480bbf640 1 -- 172.21.15.38:0/3202748589 >> v1:172.21.15.38:6789/0 conn(0x7f147c0bc310 legacy=0x7f147c14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1480bbf640 1 -- 172.21.15.38:0/3202748589 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c14ba20 con 0x7f147c14a860 2023-06-23T18:50:31.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1480bbf640 1 --2- 172.21.15.38:0/3202748589 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 0x7f147c0bba50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1474009dc0 tx=0x7f147401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eee615a14b97ac5f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a5990 con 0x7f147c14a860 2023-06-23T18:50:31.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740a5af0 con 0x7f147c14a860 2023-06-23T18:50:31.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f147affd640 1 -- 172.21.15.38:0/3202748589 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a5e60 con 0x7f147c14a860 2023-06-23T18:50:31.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 -- 172.21.15.38:0/3202748589 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 msgr2=0x7f147c0bba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 --2- 172.21.15.38:0/3202748589 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 0x7f147c0bba50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1474009dc0 tx=0x7f147401c8b0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 -- 172.21.15.38:0/3202748589 shutdown_connections 2023-06-23T18:50:31.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 --2- 172.21.15.38:0/3202748589 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c14a860 0x7f147c0bba50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 -- 172.21.15.38:0/3202748589 >> 172.21.15.38:0/3202748589 conn(0x7f147c0bfe30 msgr2=0x7f147c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 -- 172.21.15.38:0/3202748589 shutdown_connections 2023-06-23T18:50:31.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.071+0000 7f1482622640 1 -- 172.21.15.38:0/3202748589 wait complete. 2023-06-23T18:50:31.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 Processor -- start 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- start start 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c06c4b0 0x7f147c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147c14a860 0x7f147c140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1e5e50 con 0x7f147c0bc310 2023-06-23T18:50:31.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c140ed0 con 0x7f147c14a860 2023-06-23T18:50:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c137210 con 0x7f147c06c4b0 2023-06-23T18:50:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54488/0 (socket says 172.21.15.38:54488) 2023-06-23T18:50:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 -- 172.21.15.38:0/57581286 learned_addr learned my addr 172.21.15.38:0/57581286 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1480bbf640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147c14a860 0x7f147c140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147bfff640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c06c4b0 0x7f147c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 -- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c06c4b0 msgr2=0x7f147c06ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c06c4b0 0x7f147c06ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 -- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147c14a860 msgr2=0x7f147c140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147c14a860 0x7f147c140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 -- 172.21.15.38:0/57581286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009a70 con 0x7f147c0bc310 2023-06-23T18:50:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f147b7fe640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f147000c4d0 tx=0x7f147000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470005cf0 con 0x7f147c0bc310 2023-06-23T18:50:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c1e1ff0 con 0x7f147c0bc310 2023-06-23T18:50:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470005e50 con 0x7f147c0bc310 2023-06-23T18:50:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700072b0 con 0x7f147c0bc310 2023-06-23T18:50:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c0bed10 con 0x7f147c0bc310 2023-06-23T18:50:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c04d790 con 0x7f147c0bc310 2023-06-23T18:50:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.075+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1470007410 con 0x7f147c0bc310 2023-06-23T18:50:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.079+0000 7f1478ff9640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 0x7f1468068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.079+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14700835f0 con 0x7f147c0bc310 2023-06-23T18:50:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.079+0000 7f147bfff640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 0x7f1468068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.079+0000 7f147bfff640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 0x7f1468068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f146c007fd0 tx=0x7f146c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.083+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1470050790 con 0x7f147c0bc310 2023-06-23T18:50:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f147c1497a0 con 0x7f147c0bc310 2023-06-23T18:50:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1478ff9640 1 -- 172.21.15.38:0/57581286 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1470053db0 con 0x7f147c0bc310 2023-06-23T18:50:31.245 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 msgr2=0x7f1468068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 0x7f1468068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f146c007fd0 tx=0x7f146c009040 comp rx=0 tx=0).stop 2023-06-23T18:50:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 msgr2=0x7f147c140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f147000c4d0 tx=0x7f147000c990 comp rx=0 tx=0).stop 2023-06-23T18:50:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 shutdown_connections 2023-06-23T18:50:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1468066280 0x7f1468068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147c14a860 0x7f147c140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f147c0bc310 0x7f147c140450 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 --2- 172.21.15.38:0/57581286 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f147c06c4b0 0x7f147c06ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 >> 172.21.15.38:0/57581286 conn(0x7f147c0bfe30 msgr2=0x7f147c0bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 shutdown_connections 2023-06-23T18:50:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.235+0000 7f1482622640 1 -- 172.21.15.38:0/57581286 wait complete. 2023-06-23T18:50:31.263 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:31.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 Processor -- start 2023-06-23T18:50:31.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 -- start start 2023-06-23T18:50:31.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f599c06c4b0 0x7f599c0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c0ba7f0 0x7f599c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f599c149270 0x7f599c1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c1504e0 con 0x7f599c149270 2023-06-23T18:50:31.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c070270 con 0x7f599c06c4b0 2023-06-23T18:50:31.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f59a1a68640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c149c30 con 0x7f599c0ba7f0 2023-06-23T18:50:31.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f599c149270 0x7f599c1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f599c149270 0x7f599c1496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54494/0 (socket says 172.21.15.38:54494) 2023-06-23T18:50:31.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 -- 172.21.15.38:0/397331043 learned_addr learned my addr 172.21.15.38:0/397331043 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599affd640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c0ba7f0 0x7f599c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599b7fe640 1 --2- 172.21.15.38:0/397331043 >> v2:172.21.15.81:3300/0 conn(0x7f599c06c4b0 0x7f599c0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 -- 172.21.15.38:0/397331043 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c0ba7f0 msgr2=0x7f599c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c0ba7f0 0x7f599c14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 -- 172.21.15.38:0/397331043 >> v2:172.21.15.81:3300/0 conn(0x7f599c06c4b0 msgr2=0x7f599c0c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 --2- 172.21.15.38:0/397331043 >> v2:172.21.15.81:3300/0 conn(0x7f599c06c4b0 0x7f599c0c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.371+0000 7f599bfff640 1 -- 172.21.15.38:0/397331043 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c14ff20 con 0x7f599c149270 2023-06-23T18:50:31.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599bfff640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c149270 0x7f599c1496f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f599c06dc30 tx=0x7f598c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dc8cf345e41c85 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599a7fc640 1 -- 172.21.15.38:0/397331043 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0ab600 con 0x7f599c149270 2023-06-23T18:50:31.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599a7fc640 1 -- 172.21.15.38:0/397331043 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c0a7050 con 0x7f599c149270 2023-06-23T18:50:31.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599a7fc640 1 -- 172.21.15.38:0/397331043 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0ab980 con 0x7f599c149270 2023-06-23T18:50:31.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/397331043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c149270 msgr2=0x7f599c1496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c149270 0x7f599c1496f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f599c06dc30 tx=0x7f598c01c470 comp rx=0 tx=0).stop 2023-06-23T18:50:31.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/397331043 shutdown_connections 2023-06-23T18:50:31.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c149270 0x7f599c1496f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- 172.21.15.38:0/397331043 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c0ba7f0 0x7f599c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- 172.21.15.38:0/397331043 >> v2:172.21.15.81:3300/0 conn(0x7f599c06c4b0 0x7f599c0c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/397331043 >> 172.21.15.38:0/397331043 conn(0x7f599c0bfe30 msgr2=0x7f599c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/397331043 shutdown_connections 2023-06-23T18:50:31.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/397331043 wait complete. 2023-06-23T18:50:31.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 Processor -- start 2023-06-23T18:50:31.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- start start 2023-06-23T18:50:31.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 0x7f599c1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 0x7f599c149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c14b120 con 0x7f599c0ba7f0 2023-06-23T18:50:31.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c13f1d0 con 0x7f599c06c4b0 2023-06-23T18:50:31.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c143260 con 0x7f599c149270 2023-06-23T18:50:31.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54496/0 (socket says 172.21.15.38:54496) 2023-06-23T18:50:31.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 -- 172.21.15.38:0/398635447 learned_addr learned my addr 172.21.15.38:0/398635447 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599bfff640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 0x7f599c149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599b7fe640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 0x7f599c1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 -- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 msgr2=0x7f599c149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 0x7f599c149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 -- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 msgr2=0x7f599c1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 0x7f599c1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 -- 172.21.15.38:0/398635447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0094d0 con 0x7f599c0ba7f0 2023-06-23T18:50:31.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599b7fe640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 0x7f599c1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:31.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599bfff640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 0x7f599c149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:31.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f599affd640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f598400d830 tx=0x7f598400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400b6c0 con 0x7f599c0ba7f0 2023-06-23T18:50:31.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400b820 con 0x7f599c0ba7f0 2023-06-23T18:50:31.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c147700 con 0x7f599c0ba7f0 2023-06-23T18:50:31.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400bb90 con 0x7f599c0ba7f0 2023-06-23T18:50:31.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.375+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c148640 con 0x7f599c0ba7f0 2023-06-23T18:50:31.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c04d790 con 0x7f599c0ba7f0 2023-06-23T18:50:31.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f598401e460 con 0x7f599c0ba7f0 2023-06-23T18:50:31.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f5993fff640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 0x7f597c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5984084720 con 0x7f599c0ba7f0 2023-06-23T18:50:31.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f599b7fe640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 0x7f597c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.379+0000 7f599b7fe640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 0x7f597c068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599c0b60f0 tx=0x7f599400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.383+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5984051940 con 0x7f599c0ba7f0 2023-06-23T18:50:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.527+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f599c13f310 con 0x7f599c0ba7f0 2023-06-23T18:50:31.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.527+0000 7f5993fff640 1 -- 172.21.15.38:0/398635447 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5984054f60 con 0x7f599c0ba7f0 2023-06-23T18:50:31.537 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 msgr2=0x7f597c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 0x7f597c068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599c0b60f0 tx=0x7f599400b040 comp rx=0 tx=0).stop 2023-06-23T18:50:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 msgr2=0x7f599c142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f598400d830 tx=0x7f598400dcf0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 shutdown_connections 2023-06-23T18:50:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f597c066280 0x7f597c068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f599c149270 0x7f599c149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f599c0ba7f0 0x7f599c142d20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 --2- 172.21.15.38:0/398635447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599c06c4b0 0x7f599c1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 >> 172.21.15.38:0/398635447 conn(0x7f599c0bfe30 msgr2=0x7f599c14f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 shutdown_connections 2023-06-23T18:50:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.531+0000 7f59a1a68640 1 -- 172.21.15.38:0/398635447 wait complete. 2023-06-23T18:50:31.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:31.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 Processor -- start 2023-06-23T18:50:31.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 -- start start 2023-06-23T18:50:31.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9ce80bedc0 0x7f9ce80a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ce80c30b0 0x7f9ce81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80a3290 con 0x7f9ce80be9f0 2023-06-23T18:50:31.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80c28f0 con 0x7f9ce80c30b0 2023-06-23T18:50:31.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cf06bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80c2a30 con 0x7f9ce80bedc0 2023-06-23T18:50:31.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ce80c30b0 0x7f9ce81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ce80c30b0 0x7f9ce81518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54508/0 (socket says 172.21.15.38:54508) 2023-06-23T18:50:31.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 -- 172.21.15.38:0/2866349319 learned_addr learned my addr 172.21.15.38:0/2866349319 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9cedc56640 1 --2- 172.21.15.38:0/2866349319 >> v2:172.21.15.81:3300/0 conn(0x7f9ce80bedc0 0x7f9ce80a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 -- 172.21.15.38:0/2866349319 >> v2:172.21.15.81:3300/0 conn(0x7f9ce80bedc0 msgr2=0x7f9ce80a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 --2- 172.21.15.38:0/2866349319 >> v2:172.21.15.81:3300/0 conn(0x7f9ce80bedc0 0x7f9ce80a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 -- 172.21.15.38:0/2866349319 >> v1:172.21.15.81:6789/0 conn(0x7f9ce80be9f0 legacy=0x7f9ce80c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 -- 172.21.15.38:0/2866349319 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80b78f0 con 0x7f9ce80c30b0 2023-06-23T18:50:31.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.667+0000 7f9ceec58640 1 --2- 172.21.15.38:0/2866349319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80c30b0 0x7f9ce81518d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80a6900 tx=0x7f9ce001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab513d1e97c5033c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9ced455640 1 -- 172.21.15.38:0/2866349319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a5590 con 0x7f9ce80c30b0 2023-06-23T18:50:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9ced455640 1 -- 172.21.15.38:0/2866349319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00a56f0 con 0x7f9ce80c30b0 2023-06-23T18:50:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9ced455640 1 -- 172.21.15.38:0/2866349319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a5a80 con 0x7f9ce80c30b0 2023-06-23T18:50:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2866349319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80c30b0 msgr2=0x7f9ce81518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2866349319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80c30b0 0x7f9ce81518d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80a6900 tx=0x7f9ce001c990 comp rx=0 tx=0).stop 2023-06-23T18:50:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2866349319 shutdown_connections 2023-06-23T18:50:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2866349319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80c30b0 0x7f9ce81518d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2866349319 >> v2:172.21.15.81:3300/0 conn(0x7f9ce80bedc0 0x7f9ce80a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2866349319 >> 172.21.15.38:0/2866349319 conn(0x7f9ce8060b10 msgr2=0x7f9ce80a5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2866349319 shutdown_connections 2023-06-23T18:50:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2866349319 wait complete. 2023-06-23T18:50:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 Processor -- start 2023-06-23T18:50:31.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- start start 2023-06-23T18:50:31.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ce80c30b0 0x7f9ce8146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce80b6b20 0x7f9ce80b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a52d0 con 0x7f9ce80be9f0 2023-06-23T18:50:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8147220 con 0x7f9ce80b6b20 2023-06-23T18:50:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80a4c80 con 0x7f9ce80c30b0 2023-06-23T18:50:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54524/0 (socket says 172.21.15.38:54524) 2023-06-23T18:50:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 -- 172.21.15.38:0/2751877801 learned_addr learned my addr 172.21.15.38:0/2751877801 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 -- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ce80c30b0 msgr2=0x7f9ce8146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ce80c30b0 0x7f9ce8146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 -- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce80b6b20 msgr2=0x7f9ce80b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce80b6b20 0x7f9ce80b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 -- 172.21.15.38:0/2751877801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009b30 con 0x7f9ce80be9f0 2023-06-23T18:50:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cee457640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c480 tx=0x7f9ce400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4012830 con 0x7f9ce80be9f0 2023-06-23T18:50:31.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40129b0 con 0x7f9ce80be9f0 2023-06-23T18:50:31.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80a4f60 con 0x7f9ce80be9f0 2023-06-23T18:50:31.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4012d60 con 0x7f9ce80be9f0 2023-06-23T18:50:31.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.671+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80a5840 con 0x7f9ce80be9f0 2023-06-23T18:50:31.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce81eac40 con 0x7f9ce80be9f0 2023-06-23T18:50:31.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ce401c460 con 0x7f9ce80be9f0 2023-06-23T18:50:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cdeffd640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 0x7f9ccc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ce4083e90 con 0x7f9ce80be9f0 2023-06-23T18:50:31.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cedc56640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 0x7f9ccc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.675+0000 7f9cedc56640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 0x7f9ccc068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ce806b5e0 tx=0x7f9cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.679+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ce40510b0 con 0x7f9ce80be9f0 2023-06-23T18:50:31.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.823+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ce804d790 con 0x7f9ce80be9f0 2023-06-23T18:50:31.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.823+0000 7f9cdeffd640 1 -- 172.21.15.38:0/2751877801 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ce40546d0 con 0x7f9ce80be9f0 2023-06-23T18:50:31.834 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:31.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 msgr2=0x7f9ccc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 0x7f9ccc068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ce806b5e0 tx=0x7f9cd8008040 comp rx=0 tx=0).stop 2023-06-23T18:50:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 msgr2=0x7f9ce81ea700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c480 tx=0x7f9ce400c940 comp rx=0 tx=0).stop 2023-06-23T18:50:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 shutdown_connections 2023-06-23T18:50:31.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9ccc0662b0 0x7f9ccc068760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce80b6b20 0x7f9ce80b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ce80c30b0 0x7f9ce8146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 --2- 172.21.15.38:0/2751877801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ce80be9f0 0x7f9ce81ea700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 >> 172.21.15.38:0/2751877801 conn(0x7f9ce8060b10 msgr2=0x7f9ce814b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 shutdown_connections 2023-06-23T18:50:31.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.827+0000 7f9cf06bb640 1 -- 172.21.15.38:0/2751877801 wait complete. 2023-06-23T18:50:31.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.963+0000 7f9cbe1fa640 1 Processor -- start 2023-06-23T18:50:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.963+0000 7f9cbe1fa640 1 -- start start 2023-06-23T18:50:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cbe1fa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9cb80c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cbe1fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9cb80ba7f0 0x7f9cb814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cbe1fa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb8070270 con 0x7f9cb8149270 2023-06-23T18:50:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cbe1fa640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb81504e0 con 0x7f9cb80ba7f0 2023-06-23T18:50:31.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cbe1fa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814ff20 con 0x7f9cb806c4b0 2023-06-23T18:50:31.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9cb8149270 0x7f9cb81496f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57444/0 (socket says 172.21.15.38:57444) 2023-06-23T18:50:31.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 -- 172.21.15.38:0/3627940014 learned_addr learned my addr 172.21.15.38:0/3627940014 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:31.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb6ffd640 1 --2- 172.21.15.38:0/3627940014 >> v2:172.21.15.81:3300/0 conn(0x7f9cb80ba7f0 0x7f9cb814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb77fe640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9cb80c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670089830 0 0) 0x7f9cb8070270 con 0x7f9cb8149270 2023-06-23T18:50:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca4003530 con 0x7f9cb8149270 2023-06-23T18:50:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999515828 0 0) 0x7f9ca4003530 con 0x7f9cb8149270 2023-06-23T18:50:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 msgr2=0x7f9cb80c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9cb80c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 >> v2:172.21.15.81:3300/0 conn(0x7f9cb80ba7f0 msgr2=0x7f9cb814bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 --2- 172.21.15.38:0/3627940014 >> v2:172.21.15.81:3300/0 conn(0x7f9cb80ba7f0 0x7f9cb814bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8150200 con 0x7f9cb8149270 2023-06-23T18:50:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f9ca8001a00 con 0x7f9cb8149270 2023-06-23T18:50:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 >> v1:172.21.15.38:6789/0 conn(0x7f9cb8149270 legacy=0x7f9cb81496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9ca4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca4003f00 0x7f9ca40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ca4004d10 0x7f9ca4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb81504e0 con 0x7f9ca4004d10 2023-06-23T18:50:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814ff20 con 0x7f9ca4003f00 2023-06-23T18:50:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca400b9c0 con 0x7f9cb806c4b0 2023-06-23T18:50:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ca4004d10 0x7f9ca4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb77fe640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9ca4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb6ffd640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca4003f00 0x7f9ca40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 -- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 msgr2=0x7f9ca4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb806c4b0 0x7f9ca4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 -- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca4003f00 msgr2=0x7f9ca40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca4003f00 0x7f9ca40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb7fff640 1 -- 172.21.15.38:0/3627940014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4003530 con 0x7f9ca4004d10 2023-06-23T18:50:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.967+0000 7f9cb6ffd640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca4003f00 0x7f9ca40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ca4004d10 0x7f9ca4005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800a830 tx=0x7f9ca801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb333eafd620af0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80aa6d0 con 0x7f9ca4004d10 2023-06-23T18:50:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca80aa830 con 0x7f9ca4004d10 2023-06-23T18:50:31.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb67fc640 1 -- 172.21.15.38:0/3627940014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80aabe0 con 0x7f9ca4004d10 2023-06-23T18:50:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/3627940014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ca4004d10 msgr2=0x7f9ca4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/3627940014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ca4004d10 0x7f9ca4005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800a830 tx=0x7f9ca801fa40 comp rx=0 tx=0).stop 2023-06-23T18:50:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 -- 172.21.15.38:0/3627940014 reap_dead start 2023-06-23T18:50:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/3627940014 shutdown_connections 2023-06-23T18:50:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/3627940014 >> 172.21.15.38:0/3627940014 conn(0x7f9cb80bfe30 msgr2=0x7f9cb80c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/3627940014 shutdown_connections 2023-06-23T18:50:31.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/3627940014 wait complete. 2023-06-23T18:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 Processor -- start 2023-06-23T18:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- start start 2023-06-23T18:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb814bff0 0x7f9cb8144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb814f430 0x7f9cb8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b7c90 con 0x7f9cb80b62f0 2023-06-23T18:50:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb81458f0 con 0x7f9cb814f430 2023-06-23T18:50:31.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cbe1fa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80a5b70 con 0x7f9cb814bff0 2023-06-23T18:50:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54536/0 (socket says 172.21.15.38:54536) 2023-06-23T18:50:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 -- 172.21.15.38:0/4018081092 learned_addr learned my addr 172.21.15.38:0/4018081092 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 -- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb814bff0 msgr2=0x7f9cb8144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb814bff0 0x7f9cb8144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb6ffd640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb814f430 0x7f9cb8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 -- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb814f430 msgr2=0x7f9cb8144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb814f430 0x7f9cb8144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 -- 172.21.15.38:0/4018081092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8145610 con 0x7f9cb80b62f0 2023-06-23T18:50:31.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9cb7fff640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9ca801e150 tx=0x7f9ca4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80aa6d0 con 0x7f9cb80b62f0 2023-06-23T18:50:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca80aae90 con 0x7f9cb80b62f0 2023-06-23T18:50:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.971+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80019c0 con 0x7f9cb80b62f0 2023-06-23T18:50:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb81452f0 con 0x7f9cb80b62f0 2023-06-23T18:50:31.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb814fbd0 con 0x7f9cb80b62f0 2023-06-23T18:50:31.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb804d790 con 0x7f9cb80b62f0 2023-06-23T18:50:31.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ca80b2400 con 0x7f9cb80b62f0 2023-06-23T18:50:31.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9caffff640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 0x7f9c98068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:31.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ca8121420 con 0x7f9cb80b62f0 2023-06-23T18:50:31.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9cb77fe640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 0x7f9c98068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.975+0000 7f9cb77fe640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 0x7f9c98068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000da70 tx=0x7f9cb000d5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:31.979+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ca80ee660 con 0x7f9cb80b62f0 2023-06-23T18:50:32.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.127+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9cb806ff90 con 0x7f9cb80b62f0 2023-06-23T18:50:32.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.127+0000 7f9caffff640 1 -- 172.21.15.38:0/4018081092 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ca8002000 con 0x7f9cb80b62f0 2023-06-23T18:50:32.137 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 msgr2=0x7f9c98068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 0x7f9c98068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000da70 tx=0x7f9cb000d5a0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 msgr2=0x7f9cb80b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9ca801e150 tx=0x7f9ca4005800 comp rx=0 tx=0).stop 2023-06-23T18:50:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 shutdown_connections 2023-06-23T18:50:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9c980662b0 0x7f9c98068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cb80b62f0 0x7f9cb80b95b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb814f430 0x7f9cb8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 --2- 172.21.15.38:0/4018081092 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9cb814bff0 0x7f9cb8144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 >> 172.21.15.38:0/4018081092 conn(0x7f9cb80bfe30 msgr2=0x7f9cb8148660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 shutdown_connections 2023-06-23T18:50:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.131+0000 7f9cbe1fa640 1 -- 172.21.15.38:0/4018081092 wait complete. 2023-06-23T18:50:32.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:32.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 Processor -- start 2023-06-23T18:50:32.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 -- start start 2023-06-23T18:50:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ed006a630 0x7f3ed014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00ba9d0 con 0x7f3ed014b930 2023-06-23T18:50:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00bc300 con 0x7f3ed006a630 2023-06-23T18:50:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed76bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00a5570 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ed006a630 0x7f3ed014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed4c56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ed006a630 0x7f3ed014c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:47508/0 (socket says 172.21.15.38:47508) 2023-06-23T18:50:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5457640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ed014b930 0x7f3ed006c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:48322/0 (socket says 172.21.15.38:48322) 2023-06-23T18:50:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed4c56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:36768/0 (socket says 172.21.15.38:36768) 2023-06-23T18:50:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 -- 172.21.15.38:0/1185317185 learned_addr learned my addr 172.21.15.38:0/1185317185 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 -- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 msgr2=0x7f3ed014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 -- 172.21.15.38:0/1185317185 >> v1:172.21.15.81:6789/0 conn(0x7f3ed014b930 legacy=0x7f3ed006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed5c58640 1 -- 172.21.15.38:0/1185317185 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0150160 con 0x7f3ed006a630 2023-06-23T18:50:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.259+0000 7f3ed4c56640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:50:32.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed5c58640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed006a630 0x7f3ed014c8d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009e50 tx=0x7f3ec801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62fda718e9d5845d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ec7fff640 1 -- 172.21.15.38:0/1185317185 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80a5750 con 0x7f3ed006a630 2023-06-23T18:50:32.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ec7fff640 1 -- 172.21.15.38:0/1185317185 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec80a58b0 con 0x7f3ed006a630 2023-06-23T18:50:32.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ec7fff640 1 -- 172.21.15.38:0/1185317185 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80a5c40 con 0x7f3ed006a630 2023-06-23T18:50:32.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed006a630 msgr2=0x7f3ed014c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed006a630 0x7f3ed014c8d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009e50 tx=0x7f3ec801c980 comp rx=0 tx=0).stop 2023-06-23T18:50:32.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- 172.21.15.38:0/1185317185 shutdown_connections 2023-06-23T18:50:32.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed006a630 0x7f3ed014c8d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/1185317185 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed00bd1e0 0x7f3ed014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- 172.21.15.38:0/1185317185 >> 172.21.15.38:0/1185317185 conn(0x7f3ed00c0c90 msgr2=0x7f3ed00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:32.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- 172.21.15.38:0/1185317185 shutdown_connections 2023-06-23T18:50:32.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- 172.21.15.38:0/1185317185 wait complete. 2023-06-23T18:50:32.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 Processor -- start 2023-06-23T18:50:32.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- start start 2023-06-23T18:50:32.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed006a630 0x7f3ed014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed014b930 0x7f3ed006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0141400 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01e6b80 con 0x7f3ed014b930 2023-06-23T18:50:32.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed76bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed014edd0 con 0x7f3ed006a630 2023-06-23T18:50:32.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54540/0 (socket says 172.21.15.38:54540) 2023-06-23T18:50:32.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 -- 172.21.15.38:0/4121411075 learned_addr learned my addr 172.21.15.38:0/4121411075 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:32.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed5c58640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed014b930 0x7f3ed006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed5457640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed006a630 0x7f3ed014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 -- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed006a630 msgr2=0x7f3ed014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed006a630 0x7f3ed014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 -- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed014b930 msgr2=0x7f3ed006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed014b930 0x7f3ed006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.263+0000 7f3ed4c56640 1 -- 172.21.15.38:0/4121411075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009420 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed4c56640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000ebe0 tx=0x7f3ec000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000eee0 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000cc30 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec8009b30 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0013470 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed006cd00 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed004d790 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ec00135d0 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 0x7f3eb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ec0084350 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed5457640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 0x7f3eb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.267+0000 7f3ed5457640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 0x7f3eb4068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc000f70 tx=0x7f3ecc007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.271+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ec0054f80 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.443+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ed0066f10 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.443+0000 7f3ec5ffb640 1 -- 172.21.15.38:0/4121411075 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ec0054b10 con 0x7f3ed00bd1e0 2023-06-23T18:50:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 msgr2=0x7f3eb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 0x7f3eb4068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc000f70 tx=0x7f3ecc007cb0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 msgr2=0x7f3ed006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000ebe0 tx=0x7f3ec000c520 comp rx=0 tx=0).stop 2023-06-23T18:50:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 shutdown_connections 2023-06-23T18:50:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f3eb4066280 0x7f3eb4068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ed014b930 0x7f3ed006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed00bd1e0 0x7f3ed006e050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 --2- 172.21.15.38:0/4121411075 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ed006a630 0x7f3ed014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 >> 172.21.15.38:0/4121411075 conn(0x7f3ed00c0c90 msgr2=0x7f3ed014a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 shutdown_connections 2023-06-23T18:50:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.447+0000 7f3ed76bb640 1 -- 172.21.15.38:0/4121411075 wait complete. 2023-06-23T18:50:32.471 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi164.front.sepia.ceph.com... 2023-06-23T18:50:32.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:32.472 DEBUG:teuthology.orchestra.run.smithi164:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-23T18:50:32.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:ceph-fuse[32754]: fuse finished with error 0 and tester_r 0 2023-06-23T18:50:32.575 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:50:32.607 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2023-06-23T18:50:32.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:32.608 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-23T18:50:32.668 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:50:32.669 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:32.675 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:50:32.676 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:32.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:32.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.851+0000 7f1697a2e640 1 Processor -- start 2023-06-23T18:50:32.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.851+0000 7f1697a2e640 1 -- start start 2023-06-23T18:50:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f16900a30c0 0x7f16900a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16900c0c70 0x7f16900bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1690152830 con 0x7f16900bea40 2023-06-23T18:50:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900bf350 con 0x7f16900a30c0 2023-06-23T18:50:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900c22a0 con 0x7f16900c0c70 2023-06-23T18:50:32.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f16900a30c0 0x7f16900a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f16957ca640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f16900bea40 0x7f169006a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57448/0 (socket says 172.21.15.38:57448) 2023-06-23T18:50:32.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f16957ca640 1 -- 172.21.15.38:0/1452055182 learned_addr learned my addr 172.21.15.38:0/1452055182 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:32.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 -- 172.21.15.38:0/1452055182 >> v2:172.21.15.81:3300/0 conn(0x7f16900c0c70 msgr2=0x7f16900bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:32.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1695fcb640 1 --2- 172.21.15.38:0/1452055182 >> v2:172.21.15.81:3300/0 conn(0x7f16900c0c70 0x7f16900bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1687fff640 1 -- 172.21.15.38:0/1452055182 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600677127 0 0) 0x7f1690152830 con 0x7f16900bea40 2023-06-23T18:50:32.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 --2- 172.21.15.38:0/1452055182 >> v2:172.21.15.81:3300/0 conn(0x7f16900c0c70 0x7f16900bee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 -- 172.21.15.38:0/1452055182 >> v1:172.21.15.38:6789/0 conn(0x7f16900bea40 legacy=0x7f169006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 -- 172.21.15.38:0/1452055182 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900c2870 con 0x7f16900a30c0 2023-06-23T18:50:32.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1694fc9640 1 --2- 172.21.15.38:0/1452055182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900a30c0 0x7f16900a35f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f16900c4130 tx=0x7f168001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3f43e2600a4a6a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1687fff640 1 -- 172.21.15.38:0/1452055182 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800ab600 con 0x7f16900a30c0 2023-06-23T18:50:32.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1687fff640 1 -- 172.21.15.38:0/1452055182 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16800a7050 con 0x7f16900a30c0 2023-06-23T18:50:32.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1687fff640 1 -- 172.21.15.38:0/1452055182 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800ab980 con 0x7f16900a30c0 2023-06-23T18:50:32.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- 172.21.15.38:0/1452055182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900a30c0 msgr2=0x7f16900a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 --2- 172.21.15.38:0/1452055182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900a30c0 0x7f16900a35f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f16900c4130 tx=0x7f168001c3a0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- 172.21.15.38:0/1452055182 shutdown_connections 2023-06-23T18:50:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 --2- 172.21.15.38:0/1452055182 >> v2:172.21.15.81:3300/0 conn(0x7f16900c0c70 0x7f16900bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 --2- 172.21.15.38:0/1452055182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900a30c0 0x7f16900a35f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- 172.21.15.38:0/1452055182 >> 172.21.15.38:0/1452055182 conn(0x7f16900a5cc0 msgr2=0x7f16900a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:32.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- 172.21.15.38:0/1452055182 shutdown_connections 2023-06-23T18:50:32.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.855+0000 7f1697a2e640 1 -- 172.21.15.38:0/1452055182 wait complete. 2023-06-23T18:50:32.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 Processor -- start 2023-06-23T18:50:32.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- start start 2023-06-23T18:50:32.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16900a30c0 0x7f16901e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16900bea40 0x7f16900bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900bab20 con 0x7f16900c0c70 2023-06-23T18:50:32.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900bded0 con 0x7f16900bea40 2023-06-23T18:50:32.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16901e6f80 con 0x7f16900a30c0 2023-06-23T18:50:32.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54548/0 (socket says 172.21.15.38:54548) 2023-06-23T18:50:32.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 -- 172.21.15.38:0/801573290 learned_addr learned my addr 172.21.15.38:0/801573290 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:32.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f16957ca640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16900a30c0 0x7f16901e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1694fc9640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16900bea40 0x7f16900bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 -- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16900a30c0 msgr2=0x7f16901e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16900a30c0 0x7f16901e6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 -- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16900bea40 msgr2=0x7f16900bcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:32.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16900bea40 0x7f16900bcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:32.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 -- 172.21.15.38:0/801573290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680009420 con 0x7f16900c0c70 2023-06-23T18:50:32.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1695fcb640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f168800cc30 tx=0x7f168800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800ce40 con 0x7f16900c0c70 2023-06-23T18:50:32.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880039a0 con 0x7f16900c0c70 2023-06-23T18:50:32.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16900ba480 con 0x7f16900c0c70 2023-06-23T18:50:32.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688003d30 con 0x7f16900c0c70 2023-06-23T18:50:32.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16900bd420 con 0x7f16900c0c70 2023-06-23T18:50:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.859+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169004d790 con 0x7f16900c0c70 2023-06-23T18:50:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.863+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1688003e90 con 0x7f16900c0c70 2023-06-23T18:50:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.863+0000 7f1685ffb640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 0x7f1674068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.863+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1688084420 con 0x7f16900c0c70 2023-06-23T18:50:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.863+0000 7f16957ca640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 0x7f1674068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:32.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.863+0000 7f16957ca640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 0x7f1674068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f168c000f70 tx=0x7f168c007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:32.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:32.867+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16880515a0 con 0x7f16900c0c70 2023-06-23T18:50:33.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.023+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16900c3950 con 0x7f16900c0c70 2023-06-23T18:50:33.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.023+0000 7f1685ffb640 1 -- 172.21.15.38:0/801573290 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f1688054bc0 con 0x7f16900c0c70 2023-06-23T18:50:33.035 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:33.035 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 msgr2=0x7f1674068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 0x7f1674068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f168c000f70 tx=0x7f168c007b60 comp rx=0 tx=0).stop 2023-06-23T18:50:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 msgr2=0x7f16900bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f168800cc30 tx=0x7f168800a5c0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 shutdown_connections 2023-06-23T18:50:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f1674066280 0x7f1674068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16900c0c70 0x7f16900bc270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16900bea40 0x7f16900bcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 --2- 172.21.15.38:0/801573290 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16900a30c0 0x7f16901e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 >> 172.21.15.38:0/801573290 conn(0x7f16900a5cc0 msgr2=0x7f1690148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 shutdown_connections 2023-06-23T18:50:33.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.027+0000 7f1697a2e640 1 -- 172.21.15.38:0/801573290 wait complete. 2023-06-23T18:50:33.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:33.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:33.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.175+0000 7f2bb3402640 1 Processor -- start 2023-06-23T18:50:33.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.175+0000 7f2bb3402640 1 -- start start 2023-06-23T18:50:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb3402640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2bac06c4b0 0x7f2bac0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb3402640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 0x7f2bac14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb3402640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac070270 con 0x7f2bac0ba7f0 2023-06-23T18:50:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb3402640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac1504e0 con 0x7f2bac06c4b0 2023-06-23T18:50:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb3402640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac14ff20 con 0x7f2bac149980 2023-06-23T18:50:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2bac06c4b0 0x7f2bac0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2bac06c4b0 0x7f2bac0c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54564/0 (socket says 172.21.15.38:54564) 2023-06-23T18:50:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 -- 172.21.15.38:0/642607976 learned_addr learned my addr 172.21.15.38:0/642607976 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb199f640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 0x7f2bac14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 -- 172.21.15.38:0/642607976 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 msgr2=0x7f2bac14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 0x7f2bac14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 -- 172.21.15.38:0/642607976 >> v1:172.21.15.81:6789/0 conn(0x7f2bac0ba7f0 legacy=0x7f2bac149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 -- 172.21.15.38:0/642607976 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac150200 con 0x7f2bac06c4b0 2023-06-23T18:50:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb199f640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 0x7f2bac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2bb119e640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac06c4b0 0x7f2bac0c09d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c5615117ddedb7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2ba3fff640 1 -- 172.21.15.38:0/642607976 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80ab600 con 0x7f2bac06c4b0 2023-06-23T18:50:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2ba3fff640 1 -- 172.21.15.38:0/642607976 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba80a7050 con 0x7f2bac06c4b0 2023-06-23T18:50:33.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.179+0000 7f2ba3fff640 1 -- 172.21.15.38:0/642607976 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80ab980 con 0x7f2bac06c4b0 2023-06-23T18:50:33.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/642607976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac06c4b0 msgr2=0x7f2bac0c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac06c4b0 0x7f2bac0c09d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba801c4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/642607976 shutdown_connections 2023-06-23T18:50:33.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac149980 0x7f2bac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- 172.21.15.38:0/642607976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac06c4b0 0x7f2bac0c09d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/642607976 >> 172.21.15.38:0/642607976 conn(0x7f2bac0bfe30 msgr2=0x7f2bac0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/642607976 shutdown_connections 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/642607976 wait complete. 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 Processor -- start 2023-06-23T18:50:33.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- start start 2023-06-23T18:50:33.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bac06c4b0 0x7f2bac1e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac0ba7f0 0x7f2bac142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac13ba30 con 0x7f2bac149980 2023-06-23T18:50:33.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac141210 con 0x7f2bac06c4b0 2023-06-23T18:50:33.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac138f40 con 0x7f2bac0ba7f0 2023-06-23T18:50:33.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54572/0 (socket says 172.21.15.38:54572) 2023-06-23T18:50:33.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 -- 172.21.15.38:0/2248439144 learned_addr learned my addr 172.21.15.38:0/2248439144 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:33.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb099d640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac0ba7f0 0x7f2bac142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb119e640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bac06c4b0 0x7f2bac1e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 -- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac0ba7f0 msgr2=0x7f2bac142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac0ba7f0 0x7f2bac142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 -- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bac06c4b0 msgr2=0x7f2bac1e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bac06c4b0 0x7f2bac1e3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 -- 172.21.15.38:0/2248439144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80094d0 con 0x7f2bac149980 2023-06-23T18:50:33.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb199f640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007dc0 tx=0x7f2ba400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40039a0 con 0x7f2bac149980 2023-06-23T18:50:33.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400f040 con 0x7f2bac149980 2023-06-23T18:50:33.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac142570 con 0x7f2bac149980 2023-06-23T18:50:33.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4003d40 con 0x7f2bac149980 2023-06-23T18:50:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.183+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac14d4b0 con 0x7f2bac149980 2023-06-23T18:50:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac14d6d0 con 0x7f2bac149980 2023-06-23T18:50:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ba4004030 con 0x7f2bac149980 2023-06-23T18:50:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2ba1ffb640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 0x7f2b90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ba4084170 con 0x7f2bac149980 2023-06-23T18:50:33.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2bb119e640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 0x7f2b90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.187+0000 7f2bb119e640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 0x7f2b90068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80ad000 tx=0x7f2ba80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.191+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ba4051440 con 0x7f2bac149980 2023-06-23T18:50:33.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.343+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2bac140b90 con 0x7f2bac149980 2023-06-23T18:50:33.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.343+0000 7f2ba1ffb640 1 -- 172.21.15.38:0/2248439144 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bac140b90 con 0x7f2bac149980 2023-06-23T18:50:33.355 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 msgr2=0x7f2b90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 0x7f2b90068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80ad000 tx=0x7f2ba80a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 msgr2=0x7f2bac1e4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007dc0 tx=0x7f2ba400d4a0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 shutdown_connections 2023-06-23T18:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2b900662b0 0x7f2b90068760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bac149980 0x7f2bac1e4280 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2bac0ba7f0 0x7f2bac142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 --2- 172.21.15.38:0/2248439144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bac06c4b0 0x7f2bac1e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 >> 172.21.15.38:0/2248439144 conn(0x7f2bac0bfe30 msgr2=0x7f2bac1485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 shutdown_connections 2023-06-23T18:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.347+0000 7f2bb3402640 1 -- 172.21.15.38:0/2248439144 wait complete. 2023-06-23T18:50:33.374 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 Processor -- start 2023-06-23T18:50:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 -- start start 2023-06-23T18:50:33.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa61006f7f0 0x7fa6100ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61014b760 con 0x7fa610071010 2023-06-23T18:50:33.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6100b9ea0 con 0x7fa610149c90 2023-06-23T18:50:33.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa61528c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6100ba180 con 0x7fa61006f7f0 2023-06-23T18:50:33.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa60e7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa61006f7f0 0x7fa6100ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa60f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa610071010 0x7fa61014db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57454/0 (socket says 172.21.15.38:57454) 2023-06-23T18:50:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.495+0000 7fa60f7fe640 1 -- 172.21.15.38:0/2538779616 learned_addr learned my addr 172.21.15.38:0/2538779616 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60e7fc640 1 -- 172.21.15.38:0/2538779616 >> v1:172.21.15.81:6789/0 conn(0x7fa610149c90 legacy=0x7fa61014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60e7fc640 1 -- 172.21.15.38:0/2538779616 >> v1:172.21.15.38:6789/0 conn(0x7fa610071010 legacy=0x7fa61014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60e7fc640 1 -- 172.21.15.38:0/2538779616 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61014e980 con 0x7fa61006f7f0 2023-06-23T18:50:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60e7fc640 1 --2- 172.21.15.38:0/2538779616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa6100ba7f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009d90 tx=0x7fa5f801da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b6d62c6c75c6fc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60dffb640 1 -- 172.21.15.38:0/2538779616 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80a6a50 con 0x7fa61006f7f0 2023-06-23T18:50:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60dffb640 1 -- 172.21.15.38:0/2538779616 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80a6bb0 con 0x7fa61006f7f0 2023-06-23T18:50:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa60dffb640 1 -- 172.21.15.38:0/2538779616 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ae440 con 0x7fa61006f7f0 2023-06-23T18:50:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 -- 172.21.15.38:0/2538779616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 msgr2=0x7fa6100ba7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 --2- 172.21.15.38:0/2538779616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa6100ba7f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009d90 tx=0x7fa5f801da60 comp rx=0 tx=0).stop 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 -- 172.21.15.38:0/2538779616 shutdown_connections 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 --2- 172.21.15.38:0/2538779616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa6100ba7f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 -- 172.21.15.38:0/2538779616 >> 172.21.15.38:0/2538779616 conn(0x7fa6100bfe30 msgr2=0x7fa6100c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 -- 172.21.15.38:0/2538779616 shutdown_connections 2023-06-23T18:50:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.499+0000 7fa61528c640 1 -- 172.21.15.38:0/2538779616 wait complete. 2023-06-23T18:50:33.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 Processor -- start 2023-06-23T18:50:33.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- start start 2023-06-23T18:50:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa610071010 0x7fa610141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa610149c90 0x7fa6101372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61013c8d0 con 0x7fa61006f7f0 2023-06-23T18:50:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610141990 con 0x7fa610149c90 2023-06-23T18:50:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6101e4080 con 0x7fa610071010 2023-06-23T18:50:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54576/0 (socket says 172.21.15.38:54576) 2023-06-23T18:50:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 -- 172.21.15.38:0/994385363 learned_addr learned my addr 172.21.15.38:0/994385363 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60f7fe640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa610149c90 0x7fa6101372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60e7fc640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa610071010 0x7fa610141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 -- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa610071010 msgr2=0x7fa610141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa610071010 0x7fa610141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 -- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa610149c90 msgr2=0x7fa6101372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa610149c90 0x7fa6101372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 -- 172.21.15.38:0/994385363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8009a70 con 0x7fa61006f7f0 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa60effd640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c500 tx=0x7fa60000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600005220 con 0x7fa61006f7f0 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600005380 con 0x7fa61006f7f0 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61013b620 con 0x7fa61006f7f0 2023-06-23T18:50:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600007270 con 0x7fa61006f7f0 2023-06-23T18:50:33.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61013bc60 con 0x7fa61006f7f0 2023-06-23T18:50:33.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61004d790 con 0x7fa61006f7f0 2023-06-23T18:50:33.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6000073d0 con 0x7fa61006f7f0 2023-06-23T18:50:33.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.503+0000 7fa6077fe640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 0x7fa5f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.507+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa600083910 con 0x7fa61006f7f0 2023-06-23T18:50:33.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.507+0000 7fa60e7fc640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 0x7fa5f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.507+0000 7fa60e7fc640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 0x7fa5f0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80b0000 tx=0x7fa5f80a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.511+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa600050ab0 con 0x7fa61006f7f0 2023-06-23T18:50:33.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6100bae80 con 0x7fa61006f7f0 2023-06-23T18:50:33.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa6077fe640 1 -- 172.21.15.38:0/994385363 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6000540d0 con 0x7fa61006f7f0 2023-06-23T18:50:33.677 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:33.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 msgr2=0x7fa5f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 0x7fa5f0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80b0000 tx=0x7fa5f80a8070 comp rx=0 tx=0).stop 2023-06-23T18:50:33.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 msgr2=0x7fa61013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c500 tx=0x7fa60000c9c0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 shutdown_connections 2023-06-23T18:50:33.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fa5f0066280 0x7fa5f0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa610149c90 0x7fa6101372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa610071010 0x7fa610141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 --2- 172.21.15.38:0/994385363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa61006f7f0 0x7fa61013f510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 >> 172.21.15.38:0/994385363 conn(0x7fa6100bfe30 msgr2=0x7fa61006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.667+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 shutdown_connections 2023-06-23T18:50:33.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.671+0000 7fa61528c640 1 -- 172.21.15.38:0/994385363 wait complete. 2023-06-23T18:50:33.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:33.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 Processor -- start 2023-06-23T18:50:33.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 -- start start 2023-06-23T18:50:33.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1400712c0 0x7fc14014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400b6490 0x7fc1400b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400b6270 con 0x7fc1400696d0 2023-06-23T18:50:33.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc140071110 con 0x7fc1400712c0 2023-06-23T18:50:33.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc1473ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14014e320 con 0x7fc1400b6490 2023-06-23T18:50:33.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc144965640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1400712c0 0x7fc14014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc144965640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1400712c0 0x7fc14014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54578/0 (socket says 172.21.15.38:54578) 2023-06-23T18:50:33.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc144965640 1 -- 172.21.15.38:0/211872268 learned_addr learned my addr 172.21.15.38:0/211872268 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:33.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc145166640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc1400696d0 0x7fc14014d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57456/0 (socket says 172.21.15.38:57456) 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.807+0000 7fc145967640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400b6490 0x7fc1400b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc144965640 1 -- 172.21.15.38:0/211872268 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400b6490 msgr2=0x7fc1400b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc144965640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400b6490 0x7fc1400b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc144965640 1 -- 172.21.15.38:0/211872268 >> v1:172.21.15.38:6789/0 conn(0x7fc1400696d0 legacy=0x7fc14014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc144965640 1 -- 172.21.15.38:0/211872268 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400709c0 con 0x7fc1400712c0 2023-06-23T18:50:33.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc137fff640 1 -- 172.21.15.38:0/211872268 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137643645 0 0) 0x7fc13c001120 con 0x7fc1400696d0 2023-06-23T18:50:33.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc144965640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400712c0 0x7fc14014dde0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd35094178e3e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc137fff640 1 -- 172.21.15.38:0/211872268 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300a8a30 con 0x7fc1400712c0 2023-06-23T18:50:33.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc137fff640 1 -- 172.21.15.38:0/211872268 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300a8b90 con 0x7fc1400712c0 2023-06-23T18:50:33.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc137fff640 1 -- 172.21.15.38:0/211872268 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300b0440 con 0x7fc1400712c0 2023-06-23T18:50:33.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 -- 172.21.15.38:0/211872268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400712c0 msgr2=0x7fc14014dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400712c0 0x7fc14014dde0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13001ed30 comp rx=0 tx=0).stop 2023-06-23T18:50:33.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 -- 172.21.15.38:0/211872268 shutdown_connections 2023-06-23T18:50:33.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400b6490 0x7fc1400b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 --2- 172.21.15.38:0/211872268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400712c0 0x7fc14014dde0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 -- 172.21.15.38:0/211872268 >> 172.21.15.38:0/211872268 conn(0x7fc1400c0f40 msgr2=0x7fc1400c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 -- 172.21.15.38:0/211872268 shutdown_connections 2023-06-23T18:50:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.811+0000 7fc1473ca640 1 -- 172.21.15.38:0/211872268 wait complete. 2023-06-23T18:50:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 Processor -- start 2023-06-23T18:50:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- start start 2023-06-23T18:50:33.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400696d0 0x7fc1401d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 0x7fc14014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401d71c0 con 0x7fc1400b6490 2023-06-23T18:50:33.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14014d230 con 0x7fc1400712c0 2023-06-23T18:50:33.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14014c410 con 0x7fc1400696d0 2023-06-23T18:50:33.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54594/0 (socket says 172.21.15.38:54594) 2023-06-23T18:50:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 -- 172.21.15.38:0/2105901188 learned_addr learned my addr 172.21.15.38:0/2105901188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145166640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400696d0 0x7fc1401d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc144965640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 0x7fc14014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 -- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400696d0 msgr2=0x7fc1401d73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400696d0 0x7fc1401d73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 -- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 msgr2=0x7fc14014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 0x7fc14014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 -- 172.21.15.38:0/2105901188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094d0 con 0x7fc1400b6490 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc144965640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 0x7fc14014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc145967640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc138007e90 tx=0x7fc13800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138014420 con 0x7fc1400b6490 2023-06-23T18:50:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138014580 con 0x7fc1400b6490 2023-06-23T18:50:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14014cdc0 con 0x7fc1400b6490 2023-06-23T18:50:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138014930 con 0x7fc1400b6490 2023-06-23T18:50:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14014bce0 con 0x7fc1400b6490 2023-06-23T18:50:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.815+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14014cf50 con 0x7fc1400b6490 2023-06-23T18:50:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.819+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc138014a90 con 0x7fc1400b6490 2023-06-23T18:50:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.819+0000 7fc135ffb640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 0x7fc124068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.819+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc138085510 con 0x7fc1400b6490 2023-06-23T18:50:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.819+0000 7fc145166640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 0x7fc124068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.819+0000 7fc145166640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 0x7fc124068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc13c007fd0 tx=0x7fc13c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.823+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc138052810 con 0x7fc1400b6490 2023-06-23T18:50:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc14014cf50 con 0x7fc1400b6490 2023-06-23T18:50:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc135ffb640 1 -- 172.21.15.38:0/2105901188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc14014cf50 con 0x7fc1400b6490 2023-06-23T18:50:33.985 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:33.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 msgr2=0x7fc124068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 0x7fc124068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc13c007fd0 tx=0x7fc13c0079c0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 msgr2=0x7fc140142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.975+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc138007e90 tx=0x7fc13800e4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 shutdown_connections 2023-06-23T18:50:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc1240662b0 0x7fc124068760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1400b6490 0x7fc140142060 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1400712c0 0x7fc14014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 --2- 172.21.15.38:0/2105901188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc1400696d0 0x7fc1401d73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 >> 172.21.15.38:0/2105901188 conn(0x7fc1400c0f40 msgr2=0x7fc1401d8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 shutdown_connections 2023-06-23T18:50:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:33.979+0000 7fc1473ca640 1 -- 172.21.15.38:0/2105901188 wait complete. 2023-06-23T18:50:34.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:34.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 Processor -- start 2023-06-23T18:50:34.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 -- start start 2023-06-23T18:50:34.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f900a3850 0x7f2f900bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900bf1a0 0x7f2f90151a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900c23a0 con 0x7f2f900be890 2023-06-23T18:50:34.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900c1490 con 0x7f2f900a3850 2023-06-23T18:50:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f9715a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900aa080 con 0x7f2f900bf1a0 2023-06-23T18:50:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f900a3850 0x7f2f900bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f900a3850 0x7f2f900bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54610/0 (socket says 172.21.15.38:54610) 2023-06-23T18:50:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 -- 172.21.15.38:0/4176925985 learned_addr learned my addr 172.21.15.38:0/4176925985 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f956f7640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900bf1a0 0x7f2f90151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 -- 172.21.15.38:0/4176925985 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900bf1a0 msgr2=0x7f2f90151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900bf1a0 0x7f2f90151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 -- 172.21.15.38:0/4176925985 >> v1:172.21.15.81:6789/0 conn(0x7f2f900be890 legacy=0x7f2f900c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:34.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.127+0000 7f2f8ffff640 1 -- 172.21.15.38:0/4176925985 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900bb060 con 0x7f2f900a3850 2023-06-23T18:50:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8ffff640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f900bec60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009870 tx=0x7f2f8401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f20c963668aa08 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8f7fe640 1 -- 172.21.15.38:0/4176925985 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840ab600 con 0x7f2f900a3850 2023-06-23T18:50:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8f7fe640 1 -- 172.21.15.38:0/4176925985 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f840a7050 con 0x7f2f900a3850 2023-06-23T18:50:34.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8f7fe640 1 -- 172.21.15.38:0/4176925985 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840ab980 con 0x7f2f900a3850 2023-06-23T18:50:34.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/4176925985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 msgr2=0x7f2f900bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f900bec60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009870 tx=0x7f2f8401c3e0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/4176925985 shutdown_connections 2023-06-23T18:50:34.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900bf1a0 0x7f2f90151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- 172.21.15.38:0/4176925985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f900bec60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/4176925985 >> 172.21.15.38:0/4176925985 conn(0x7f2f900a5d50 msgr2=0x7f2f900a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/4176925985 shutdown_connections 2023-06-23T18:50:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/4176925985 wait complete. 2023-06-23T18:50:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 Processor -- start 2023-06-23T18:50:34.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- start start 2023-06-23T18:50:34.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900be890 0x7f2f9014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 0x7f2f900b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b9ea0 con 0x7f2f900a3850 2023-06-23T18:50:34.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901eab40 con 0x7f2f900b7d70 2023-06-23T18:50:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901501f0 con 0x7f2f900be890 2023-06-23T18:50:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54624/0 (socket says 172.21.15.38:54624) 2023-06-23T18:50:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 -- 172.21.15.38:0/2988211199 learned_addr learned my addr 172.21.15.38:0/2988211199 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f956f7640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 0x7f2f900b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8ffff640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900be890 0x7f2f9014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 -- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900be890 msgr2=0x7f2f9014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900be890 0x7f2f9014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 -- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 msgr2=0x7f2f900b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 0x7f2f900b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 -- 172.21.15.38:0/2988211199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840094d0 con 0x7f2f900a3850 2023-06-23T18:50:34.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f956f7640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 0x7f2f900b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f94ef6640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c7c0 tx=0x7f2f8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000aa50 con 0x7f2f900a3850 2023-06-23T18:50:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000abb0 con 0x7f2f900a3850 2023-06-23T18:50:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900b9890 con 0x7f2f900a3850 2023-06-23T18:50:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80012420 con 0x7f2f900a3850 2023-06-23T18:50:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.131+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900b9b30 con 0x7f2f900a3850 2023-06-23T18:50:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9004d790 con 0x7f2f900a3850 2023-06-23T18:50:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f80012580 con 0x7f2f900a3850 2023-06-23T18:50:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f8d7fa640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 0x7f2f7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f80084260 con 0x7f2f900a3850 2023-06-23T18:50:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f8ffff640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 0x7f2f7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.135+0000 7f2f8ffff640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 0x7f2f7c068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f840ad000 tx=0x7f2f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.139+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f800513e0 con 0x7f2f900a3850 2023-06-23T18:50:34.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.291+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f900a9890 con 0x7f2f900a3850 2023-06-23T18:50:34.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.291+0000 7f2f8d7fa640 1 -- 172.21.15.38:0/2988211199 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f80054a00 con 0x7f2f900a3850 2023-06-23T18:50:34.301 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:34.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 msgr2=0x7f2f7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 0x7f2f7c068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f840ad000 tx=0x7f2f84008040 comp rx=0 tx=0).stop 2023-06-23T18:50:34.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 msgr2=0x7f2f901ea600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c7c0 tx=0x7f2f8000cc80 comp rx=0 tx=0).stop 2023-06-23T18:50:34.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 shutdown_connections 2023-06-23T18:50:34.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2f7c066280 0x7f2f7c068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f900b7d70 0x7f2f900b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f900be890 0x7f2f9014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 --2- 172.21.15.38:0/2988211199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f900a3850 0x7f2f901ea600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 >> 172.21.15.38:0/2988211199 conn(0x7f2f900a5d50 msgr2=0x7f2f9006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 shutdown_connections 2023-06-23T18:50:34.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.295+0000 7f2f9715a640 1 -- 172.21.15.38:0/2988211199 wait complete. 2023-06-23T18:50:34.321 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:34.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.431+0000 7fc9c9169640 1 Processor -- start 2023-06-23T18:50:34.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.431+0000 7fc9c9169640 1 -- start start 2023-06-23T18:50:34.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c9169640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c9169640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9c40ba7f0 0x7fc9c414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c9169640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c4070270 con 0x7fc9c4149270 2023-06-23T18:50:34.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c9169640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c41504e0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c9169640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c414ff20 con 0x7fc9c406c4b0 2023-06-23T18:50:34.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.38:36842/0 (socket says 172.21.15.38:36842) 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 -- 172.21.15.38:0/418255387 learned_addr learned my addr 172.21.15.38:0/418255387 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c259c640 1 --2- 172.21.15.38:0/418255387 >> v2:172.21.15.81:3300/0 conn(0x7fc9c40ba7f0 0x7fc9c414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 -- 172.21.15.38:0/418255387 >> v2:172.21.15.81:3300/0 conn(0x7fc9c40ba7f0 msgr2=0x7fc9c414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 --2- 172.21.15.38:0/418255387 >> v2:172.21.15.81:3300/0 conn(0x7fc9c40ba7f0 0x7fc9c414bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 -- 172.21.15.38:0/418255387 >> v1:172.21.15.81:6789/0 conn(0x7fc9c4149270 legacy=0x7fc9c41496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.435+0000 7fc9c2d9d640 1 -- 172.21.15.38:0/418255387 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4150200 con 0x7fc9c406c4b0 2023-06-23T18:50:34.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c2d9d640 1 --2- 172.21.15.38:0/418255387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52768c8c00319fa7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c1d9b640 1 -- 172.21.15.38:0/418255387 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40ab600 con 0x7fc9c406c4b0 2023-06-23T18:50:34.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c1d9b640 1 -- 172.21.15.38:0/418255387 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40a7050 con 0x7fc9c406c4b0 2023-06-23T18:50:34.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c1d9b640 1 -- 172.21.15.38:0/418255387 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40ab980 con 0x7fc9c406c4b0 2023-06-23T18:50:34.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- 172.21.15.38:0/418255387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 msgr2=0x7fc9c40c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 --2- 172.21.15.38:0/418255387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b401c4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- 172.21.15.38:0/418255387 shutdown_connections 2023-06-23T18:50:34.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 --2- 172.21.15.38:0/418255387 >> v2:172.21.15.81:3300/0 conn(0x7fc9c40ba7f0 0x7fc9c414bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 --2- 172.21.15.38:0/418255387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c40c09d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- 172.21.15.38:0/418255387 >> 172.21.15.38:0/418255387 conn(0x7fc9c40bfe30 msgr2=0x7fc9c40c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- 172.21.15.38:0/418255387 shutdown_connections 2023-06-23T18:50:34.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- 172.21.15.38:0/418255387 wait complete. 2023-06-23T18:50:34.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 Processor -- start 2023-06-23T18:50:34.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.439+0000 7fc9c9169640 1 -- start start 2023-06-23T18:50:34.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c4140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9c4149270 0x7fc9c414d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c413edc0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4140390 con 0x7fc9c4149270 2023-06-23T18:50:34.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4140120 con 0x7fc9c406c4b0 2023-06-23T18:50:34.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54628/0 (socket says 172.21.15.38:54628) 2023-06-23T18:50:34.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 -- 172.21.15.38:0/1928204287 learned_addr learned my addr 172.21.15.38:0/1928204287 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:34.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c2d9d640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c4140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c359e640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9c4149270 0x7fc9c414d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 -- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 msgr2=0x7fc9c4140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c4140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 -- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9c4149270 msgr2=0x7fc9c414d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9c4149270 0x7fc9c414d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 -- 172.21.15.38:0/1928204287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40094d0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c259c640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e960 tx=0x7fc9ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac009690 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00ca00 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c41411c0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00cd70 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c4147fb0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c404d790 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9ac013470 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 0x7fc9a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9ac084190 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.443+0000 7fc9c2d9d640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 0x7fc9a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.447+0000 7fc9c2d9d640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 0x7fc9a4068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40ad000 tx=0x7fc9b40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.447+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9ac0513e0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc9c40bc6d0 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9bb7fe640 1 -- 172.21.15.38:0/1928204287 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc9ac054a00 con 0x7fc9c40ba7f0 2023-06-23T18:50:34.612 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:34.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 msgr2=0x7fc9a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 0x7fc9a4068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40ad000 tx=0x7fc9b40a6000 comp rx=0 tx=0).stop 2023-06-23T18:50:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 msgr2=0x7fc9c41e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e960 tx=0x7fc9ac00ee20 comp rx=0 tx=0).stop 2023-06-23T18:50:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 shutdown_connections 2023-06-23T18:50:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc9a4066280 0x7fc9a4068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9c4149270 0x7fc9c414d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9c40ba7f0 0x7fc9c41e4800 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 --2- 172.21.15.38:0/1928204287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9c406c4b0 0x7fc9c4140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 >> 172.21.15.38:0/1928204287 conn(0x7fc9c40bfe30 msgr2=0x7fc9c414b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 shutdown_connections 2023-06-23T18:50:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.603+0000 7fc9c9169640 1 -- 172.21.15.38:0/1928204287 wait complete. 2023-06-23T18:50:34.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:34.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 Processor -- start 2023-06-23T18:50:34.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 -- start start 2023-06-23T18:50:34.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f52c40c18d0 0x7f52c4152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40bd0b0 con 0x7f52c4136eb0 2023-06-23T18:50:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40bd390 con 0x7f52c414e300 2023-06-23T18:50:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c8ff3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40bbb30 con 0x7f52c40c18d0 2023-06-23T18:50:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f52c40c18d0 0x7f52c4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c1d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f52c4136eb0 0x7f52c4137330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57466/0 (socket says 172.21.15.38:57466) 2023-06-23T18:50:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c1d9b640 1 -- 172.21.15.38:0/537656122 learned_addr learned my addr 172.21.15.38:0/537656122 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c259c640 1 -- 172.21.15.38:0/537656122 >> v1:172.21.15.81:6789/0 conn(0x7f52c414e300 legacy=0x7f52c414e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c259c640 1 -- 172.21.15.38:0/537656122 >> v1:172.21.15.38:6789/0 conn(0x7f52c4136eb0 legacy=0x7f52c4137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c259c640 1 -- 172.21.15.38:0/537656122 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40bd670 con 0x7f52c40c18d0 2023-06-23T18:50:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.751+0000 7f52c159a640 1 -- 172.21.15.38:0/537656122 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914079226 0 0) 0x7f52c40bd0b0 con 0x7f52c4136eb0 2023-06-23T18:50:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c259c640 1 --2- 172.21.15.38:0/537656122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c40c18d0 0x7f52c4152030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584ebe91d2492d62 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c159a640 1 -- 172.21.15.38:0/537656122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0ab600 con 0x7f52c40c18d0 2023-06-23T18:50:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c159a640 1 -- 172.21.15.38:0/537656122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac0a7050 con 0x7f52c40c18d0 2023-06-23T18:50:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c159a640 1 -- 172.21.15.38:0/537656122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0ab980 con 0x7f52c40c18d0 2023-06-23T18:50:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/537656122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c40c18d0 msgr2=0x7f52c4152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/537656122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c40c18d0 0x7f52c4152030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac01c3b0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/537656122 shutdown_connections 2023-06-23T18:50:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/537656122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c40c18d0 0x7f52c4152030 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/537656122 >> 172.21.15.38:0/537656122 conn(0x7f52c406b210 msgr2=0x7f52c40c0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/537656122 shutdown_connections 2023-06-23T18:50:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/537656122 wait complete. 2023-06-23T18:50:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 Processor -- start 2023-06-23T18:50:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- start start 2023-06-23T18:50:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40c18d0 0x7f52c4148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 0x7f52c4145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41465b0 con 0x7f52c414e300 2023-06-23T18:50:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c0ca0 con 0x7f52c40c18d0 2023-06-23T18:50:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c406a120 con 0x7f52c4136eb0 2023-06-23T18:50:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54654/0 (socket says 172.21.15.38:54654) 2023-06-23T18:50:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 -- 172.21.15.38:0/3202880351 learned_addr learned my addr 172.21.15.38:0/3202880351 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c1d9b640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 0x7f52c4145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 -- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 msgr2=0x7f52c4145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 0x7f52c4145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 -- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40c18d0 msgr2=0x7f52c4148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40c18d0 0x7f52c4148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 -- 172.21.15.38:0/3202880351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac009420 con 0x7f52c414e300 2023-06-23T18:50:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c1d9b640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 0x7f52c4145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c2d9d640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00b970 tx=0x7f52bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00cb40 con 0x7f52c414e300 2023-06-23T18:50:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00cca0 con 0x7f52c414e300 2023-06-23T18:50:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c40c08c0 con 0x7f52c414e300 2023-06-23T18:50:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc014680 con 0x7f52c414e300 2023-06-23T18:50:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.755+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c4146270 con 0x7f52c414e300 2023-06-23T18:50:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c40c0e10 con 0x7f52c414e300 2023-06-23T18:50:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52bc01d3b0 con 0x7f52c414e300 2023-06-23T18:50:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52baffd640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 0x7f52a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52bc083f70 con 0x7f52c414e300 2023-06-23T18:50:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52c259c640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 0x7f52a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.759+0000 7f52c259c640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 0x7f52a4068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0ad000 tx=0x7f52ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.763+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52bc0510f0 con 0x7f52c414e300 2023-06-23T18:50:34.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.931+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52c404d790 con 0x7f52c414e300 2023-06-23T18:50:34.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.931+0000 7f52baffd640 1 -- 172.21.15.38:0/3202880351 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52bc054710 con 0x7f52c414e300 2023-06-23T18:50:34.942 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:34.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 msgr2=0x7f52a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 0x7f52a4068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0ad000 tx=0x7f52ac008040 comp rx=0 tx=0).stop 2023-06-23T18:50:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 msgr2=0x7f52c4146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00b970 tx=0x7f52bc00be30 comp rx=0 tx=0).stop 2023-06-23T18:50:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 shutdown_connections 2023-06-23T18:50:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f52a40662b0 0x7f52a4068760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c414e300 0x7f52c4146bb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52c4136eb0 0x7f52c4145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 --2- 172.21.15.38:0/3202880351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40c18d0 0x7f52c4148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:34.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 >> 172.21.15.38:0/3202880351 conn(0x7f52c406b210 msgr2=0x7f52c406f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:34.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 shutdown_connections 2023-06-23T18:50:34.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:34.935+0000 7f52c8ff3640 1 -- 172.21.15.38:0/3202880351 wait complete. 2023-06-23T18:50:34.960 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T18:50:34.961 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:50:34.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:35.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 Processor -- start 2023-06-23T18:50:35.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 -- start start 2023-06-23T18:50:35.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900bea40 0x7ff3900a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3900a30c0 0x7ff3900c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3900bee10 0x7ff39006a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390152830 con 0x7ff3900a30c0 2023-06-23T18:50:35.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3900c22a0 con 0x7ff3900bee10 2023-06-23T18:50:35.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff395582640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900c2870 con 0x7ff3900bea40 2023-06-23T18:50:35.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3900a30c0 0x7ff3900c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3900a30c0 0x7ff3900c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54660/0 (socket says 172.21.15.38:54660) 2023-06-23T18:50:35.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 -- 172.21.15.38:0/2757794594 learned_addr learned my addr 172.21.15.38:0/2757794594 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:35.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38effd640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900bea40 0x7ff3900a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 -- 172.21.15.38:0/2757794594 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900bea40 msgr2=0x7ff3900a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:35.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900bea40 0x7ff3900a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 -- 172.21.15.38:0/2757794594 >> v2:172.21.15.81:3300/0 conn(0x7ff3900bee10 msgr2=0x7ff39006a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:35.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38f7fe640 1 --2- 172.21.15.38:0/2757794594 >> v2:172.21.15.81:3300/0 conn(0x7ff3900bee10 0x7ff39006a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 --2- 172.21.15.38:0/2757794594 >> v2:172.21.15.81:3300/0 conn(0x7ff3900bee10 0x7ff39006a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.083+0000 7ff38e7fc640 1 -- 172.21.15.38:0/2757794594 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900b7950 con 0x7ff3900a30c0 2023-06-23T18:50:35.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38e7fc640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900a30c0 0x7ff3900c0c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3900c1cf0 tx=0x7ff38401c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a39b2ee7b401dc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38dffb640 1 -- 172.21.15.38:0/2757794594 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840ab600 con 0x7ff3900a30c0 2023-06-23T18:50:35.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38dffb640 1 -- 172.21.15.38:0/2757794594 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3840a7050 con 0x7ff3900a30c0 2023-06-23T18:50:35.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38dffb640 1 -- 172.21.15.38:0/2757794594 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840ab980 con 0x7ff3900a30c0 2023-06-23T18:50:35.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- 172.21.15.38:0/2757794594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900a30c0 msgr2=0x7ff3900c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900a30c0 0x7ff3900c0c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3900c1cf0 tx=0x7ff38401c1b0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- 172.21.15.38:0/2757794594 shutdown_connections 2023-06-23T18:50:35.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- 172.21.15.38:0/2757794594 >> v2:172.21.15.81:3300/0 conn(0x7ff3900bee10 0x7ff39006a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900a30c0 0x7ff3900c0c70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- 172.21.15.38:0/2757794594 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900bea40 0x7ff3900a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- 172.21.15.38:0/2757794594 >> 172.21.15.38:0/2757794594 conn(0x7ff3900a5cc0 msgr2=0x7ff3900a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- 172.21.15.38:0/2757794594 shutdown_connections 2023-06-23T18:50:35.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- 172.21.15.38:0/2757794594 wait complete. 2023-06-23T18:50:35.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 Processor -- start 2023-06-23T18:50:35.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- start start 2023-06-23T18:50:35.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900a30c0 0x7ff3900b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3900bea40 0x7ff390146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3901e6dc0 con 0x7ff3900bee10 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3901e6800 con 0x7ff3900bea40 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff395582640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3901e6ae0 con 0x7ff3900a30c0 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54666/0 (socket says 172.21.15.38:54666) 2023-06-23T18:50:35.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 -- 172.21.15.38:0/983233116 learned_addr learned my addr 172.21.15.38:0/983233116 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:35.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38effd640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900a30c0 0x7ff3900b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38e7fc640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3900bea40 0x7ff390146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 -- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900a30c0 msgr2=0x7ff3900b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900a30c0 0x7ff3900b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 -- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3900bea40 msgr2=0x7ff390146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3900bea40 0x7ff390146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 -- 172.21.15.38:0/983233116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840094d0 con 0x7ff3900bee10 2023-06-23T18:50:35.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.087+0000 7ff38f7fe640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff38800cd70 tx=0x7ff38800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388003ba0 con 0x7ff3900bee10 2023-06-23T18:50:35.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388003d00 con 0x7ff3900bee10 2023-06-23T18:50:35.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388004240 con 0x7ff3900bee10 2023-06-23T18:50:35.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3900b7450 con 0x7ff3900bee10 2023-06-23T18:50:35.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3901503e0 con 0x7ff3900bee10 2023-06-23T18:50:35.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900a7050 con 0x7ff3900bee10 2023-06-23T18:50:35.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3880043a0 con 0x7ff3900bee10 2023-06-23T18:50:35.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 0x7ff37c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff388012070 con 0x7ff3900bee10 2023-06-23T18:50:35.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff38effd640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 0x7ff37c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.091+0000 7ff38effd640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 0x7ff37c068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff38000ba30 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.095+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3900a7050 con 0x7ff3900bee10 2023-06-23T18:50:35.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.251+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3900a7050 con 0x7ff3900bee10 2023-06-23T18:50:35.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff3777fe640 1 -- 172.21.15.38:0/983233116 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7ff3900a7050 con 0x7ff3900bee10 2023-06-23T18:50:35.264 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:35.264 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:35.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 msgr2=0x7ff37c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 0x7ff37c068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff38000ba30 tx=0x7ff380008040 comp rx=0 tx=0).stop 2023-06-23T18:50:35.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 msgr2=0x7ff3901e9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff38800cd70 tx=0x7ff38800a660 comp rx=0 tx=0).stop 2023-06-23T18:50:35.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 shutdown_connections 2023-06-23T18:50:35.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff37c066280 0x7ff37c068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3900bee10 0x7ff3901e9170 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3900bea40 0x7ff390146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 --2- 172.21.15.38:0/983233116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3900a30c0 0x7ff3900b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 >> 172.21.15.38:0/983233116 conn(0x7ff3900a5cc0 msgr2=0x7ff39014a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 shutdown_connections 2023-06-23T18:50:35.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.255+0000 7ff395582640 1 -- 172.21.15.38:0/983233116 wait complete. 2023-06-23T18:50:35.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:49:23.322583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:49:30.802990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:49:35.167229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:49:35.710394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-23T18:49:38.811823+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-23T18:50:35.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:50:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.391+0000 7fbba943c640 1 Processor -- start 2023-06-23T18:50:35.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.391+0000 7fbba943c640 1 -- start start 2023-06-23T18:50:35.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba943c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba406e770 0x7fbba4131870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba943c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbba4131db0 0x7fbba40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba943c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba406de70 con 0x7fbba414c080 2023-06-23T18:50:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba943c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba406e3f0 con 0x7fbba406e770 2023-06-23T18:50:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba943c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba41321d0 con 0x7fbba4131db0 2023-06-23T18:50:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba406e770 0x7fbba4131870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba406e770 0x7fbba4131870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37196/0 (socket says 172.21.15.38:37196) 2023-06-23T18:50:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 -- 172.21.15.38:0/2521607531 learned_addr learned my addr 172.21.15.38:0/2521607531 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba37fe640 1 --2- 172.21.15.38:0/2521607531 >> v2:172.21.15.81:3300/0 conn(0x7fbba4131db0 0x7fbba40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 -- 172.21.15.38:0/2521607531 >> v2:172.21.15.81:3300/0 conn(0x7fbba4131db0 msgr2=0x7fbba40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 --2- 172.21.15.38:0/2521607531 >> v2:172.21.15.81:3300/0 conn(0x7fbba4131db0 0x7fbba40b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 -- 172.21.15.38:0/2521607531 >> v1:172.21.15.81:6789/0 conn(0x7fbba414c080 legacy=0x7fbba414c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 -- 172.21.15.38:0/2521607531 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba406e110 con 0x7fbba406e770 2023-06-23T18:50:35.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba27fc640 1 --2- 172.21.15.38:0/2521607531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba406e770 0x7fbba4131870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009870 tx=0x7fbb9801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f3d6590b2cdd70 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba1ffb640 1 -- 172.21.15.38:0/2521607531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980ab600 con 0x7fbba406e770 2023-06-23T18:50:35.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba1ffb640 1 -- 172.21.15.38:0/2521607531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980a7050 con 0x7fbba406e770 2023-06-23T18:50:35.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.395+0000 7fbba1ffb640 1 -- 172.21.15.38:0/2521607531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980ab980 con 0x7fbba406e770 2023-06-23T18:50:35.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/2521607531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba406e770 msgr2=0x7fbba4131870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- 172.21.15.38:0/2521607531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba406e770 0x7fbba4131870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009870 tx=0x7fbb9801c500 comp rx=0 tx=0).stop 2023-06-23T18:50:35.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/2521607531 shutdown_connections 2023-06-23T18:50:35.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- 172.21.15.38:0/2521607531 >> v2:172.21.15.81:3300/0 conn(0x7fbba4131db0 0x7fbba40b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- 172.21.15.38:0/2521607531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba406e770 0x7fbba4131870 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/2521607531 >> 172.21.15.38:0/2521607531 conn(0x7fbba40c1fe0 msgr2=0x7fbba40c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/2521607531 shutdown_connections 2023-06-23T18:50:35.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/2521607531 wait complete. 2023-06-23T18:50:35.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 Processor -- start 2023-06-23T18:50:35.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- start start 2023-06-23T18:50:35.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbba406e770 0x7fbba4143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 0x7fbba414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba414a560 con 0x7fbba4131db0 2023-06-23T18:50:35.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4142b40 con 0x7fbba414c080 2023-06-23T18:50:35.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4142830 con 0x7fbba406e770 2023-06-23T18:50:35.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37212/0 (socket says 172.21.15.38:37212) 2023-06-23T18:50:35.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 -- 172.21.15.38:0/3385717158 learned_addr learned my addr 172.21.15.38:0/3385717158 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:35.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba2ffd640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbba406e770 0x7fbba4143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba37fe640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 0x7fbba414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 -- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbba406e770 msgr2=0x7fbba4143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbba406e770 0x7fbba4143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 -- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 msgr2=0x7fbba414b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 0x7fbba414b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 -- 172.21.15.38:0/3385717158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980094d0 con 0x7fbba4131db0 2023-06-23T18:50:35.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba37fe640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 0x7fbba414b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:35.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba27fc640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ae040 tx=0x7fbb980192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980b4420 con 0x7fbba4131db0 2023-06-23T18:50:35.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980b4580 con 0x7fbba4131db0 2023-06-23T18:50:35.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba4143d00 con 0x7fbba4131db0 2023-06-23T18:50:35.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980b4930 con 0x7fbba4131db0 2023-06-23T18:50:35.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.399+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba412c220 con 0x7fbba4131db0 2023-06-23T18:50:35.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba4143b60 con 0x7fbba4131db0 2023-06-23T18:50:35.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb980b2070 con 0x7fbba4131db0 2023-06-23T18:50:35.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbb8b7fe640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 0x7fbb90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb9811d300 con 0x7fbba4131db0 2023-06-23T18:50:35.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbba2ffd640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 0x7fbb90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.403+0000 7fbba2ffd640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 0x7fbb90068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb940012f0 tx=0x7fbb94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.407+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbba4143b60 con 0x7fbba4131db0 2023-06-23T18:50:35.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.555+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbba4143b60 con 0x7fbba4131db0 2023-06-23T18:50:35.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.555+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3385717158 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbba4143b60 con 0x7fbba4131db0 2023-06-23T18:50:35.567 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-06-23T18:50:35.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 msgr2=0x7fbb90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 0x7fbb90068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbb940012f0 tx=0x7fbb94009040 comp rx=0 tx=0).stop 2023-06-23T18:50:35.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 msgr2=0x7fbba412e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ae040 tx=0x7fbb980192a0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 shutdown_connections 2023-06-23T18:50:35.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbb900662b0 0x7fbb90068760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbba414c080 0x7fbba414b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba4131db0 0x7fbba412e920 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 --2- 172.21.15.38:0/3385717158 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbba406e770 0x7fbba4143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 >> 172.21.15.38:0/3385717158 conn(0x7fbba40c1fe0 msgr2=0x7fbba414c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 shutdown_connections 2023-06-23T18:50:35.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.559+0000 7fbba943c640 1 -- 172.21.15.38:0/3385717158 wait complete. 2023-06-23T18:50:35.584 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:50:35.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 Processor -- start 2023-06-23T18:50:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 -- start start 2023-06-23T18:50:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd41006c4b0 0x7fd4100bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4100bc310 0x7fd41014a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41014d670 con 0x7fd41014a690 2023-06-23T18:50:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100bbf90 con 0x7fd4100bc310 2023-06-23T18:50:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd41511c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41014bfe0 con 0x7fd41006c4b0 2023-06-23T18:50:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40f59e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd41014a690 0x7fd41014e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46078/0 (socket says 172.21.15.38:46078) 2023-06-23T18:50:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4100bc310 0x7fd41014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40f59e640 1 -- 172.21.15.38:0/3447712459 learned_addr learned my addr 172.21.15.38:0/3447712459 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40ed9d640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd41006c4b0 0x7fd4100bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40e59c640 1 -- 172.21.15.38:0/3447712459 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd41006c4b0 msgr2=0x7fd4100bba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40e59c640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd41006c4b0 0x7fd4100bba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40e59c640 1 -- 172.21.15.38:0/3447712459 >> v1:172.21.15.38:6789/0 conn(0x7fd41014a690 legacy=0x7fd41014e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40dd9b640 1 -- 172.21.15.38:0/3447712459 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256495628 0 0) 0x7fd41014d670 con 0x7fd41014a690 2023-06-23T18:50:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.703+0000 7fd40e59c640 1 -- 172.21.15.38:0/3447712459 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41014ba20 con 0x7fd4100bc310 2023-06-23T18:50:35.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40e59c640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4100bc310 0x7fd41014a150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4040097c0 tx=0x7fd40401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2ba4006f8d7d6b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40dd9b640 1 -- 172.21.15.38:0/3447712459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040ab600 con 0x7fd4100bc310 2023-06-23T18:50:35.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40dd9b640 1 -- 172.21.15.38:0/3447712459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4040a7050 con 0x7fd4100bc310 2023-06-23T18:50:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40dd9b640 1 -- 172.21.15.38:0/3447712459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040ab980 con 0x7fd4100bc310 2023-06-23T18:50:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/3447712459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4100bc310 msgr2=0x7fd41014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4100bc310 0x7fd41014a150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4040097c0 tx=0x7fd40401c3c0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/3447712459 shutdown_connections 2023-06-23T18:50:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4100bc310 0x7fd41014a150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- 172.21.15.38:0/3447712459 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd41006c4b0 0x7fd4100bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/3447712459 >> 172.21.15.38:0/3447712459 conn(0x7fd4100bfe30 msgr2=0x7fd4100c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/3447712459 shutdown_connections 2023-06-23T18:50:35.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/3447712459 wait complete. 2023-06-23T18:50:35.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 Processor -- start 2023-06-23T18:50:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- start start 2023-06-23T18:50:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 0x7fd4101e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41014a690 0x7fd410143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101e9750 con 0x7fd41006c4b0 2023-06-23T18:50:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101e9b70 con 0x7fd41014a690 2023-06-23T18:50:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101444e0 con 0x7fd4100bc310 2023-06-23T18:50:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37222/0 (socket says 172.21.15.38:37222) 2023-06-23T18:50:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 -- 172.21.15.38:0/2328828889 learned_addr learned my addr 172.21.15.38:0/2328828889 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40e59c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 0x7fd4101e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 -- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 msgr2=0x7fd4101e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 0x7fd4101e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 -- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41014a690 msgr2=0x7fd410143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41014a690 0x7fd410143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 -- 172.21.15.38:0/2328828889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009420 con 0x7fd41006c4b0 2023-06-23T18:50:35.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40e59c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 0x7fd4101e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:35.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd40ed9d640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd40000d830 tx=0x7fd40000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000b6c0 con 0x7fd41006c4b0 2023-06-23T18:50:35.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000b820 con 0x7fd41006c4b0 2023-06-23T18:50:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd410144200 con 0x7fd41006c4b0 2023-06-23T18:50:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000bb90 con 0x7fd41006c4b0 2023-06-23T18:50:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.707+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4100c0600 con 0x7fd41006c4b0 2023-06-23T18:50:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41004d790 con 0x7fd41006c4b0 2023-06-23T18:50:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd40001e460 con 0x7fd41006c4b0 2023-06-23T18:50:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd3f77fe640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 0x7fd3fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd400084790 con 0x7fd41006c4b0 2023-06-23T18:50:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd40e59c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 0x7fd3fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.711+0000 7fd40e59c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 0x7fd3fc068760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4040ad000 tx=0x7fd404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.715+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4000519b0 con 0x7fd41006c4b0 2023-06-23T18:50:35.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.863+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd410060850 con 0x7fd41006c4b0 2023-06-23T18:50:35.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.863+0000 7fd3f77fe640 1 -- 172.21.15.38:0/2328828889 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd400054fd0 con 0x7fd41006c4b0 2023-06-23T18:50:35.874 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-06-23T18:50:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 msgr2=0x7fd3fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 0x7fd3fc068760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4040ad000 tx=0x7fd404008040 comp rx=0 tx=0).stop 2023-06-23T18:50:35.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 msgr2=0x7fd41006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd40000d830 tx=0x7fd40000dcf0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 shutdown_connections 2023-06-23T18:50:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd3fc0662b0 0x7fd3fc068760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41014a690 0x7fd410143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4100bc310 0x7fd4101e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 --2- 172.21.15.38:0/2328828889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd41006c4b0 0x7fd41006dd30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 >> 172.21.15.38:0/2328828889 conn(0x7fd4100bfe30 msgr2=0x7fd410147070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 shutdown_connections 2023-06-23T18:50:35.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.867+0000 7fd41511c640 1 -- 172.21.15.38:0/2328828889 wait complete. 2023-06-23T18:50:35.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:50:36.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.995+0000 7fce01e52640 1 Processor -- start 2023-06-23T18:50:36.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.995+0000 7fce01e52640 1 -- start start 2023-06-23T18:50:36.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fce01e52640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fce01e52640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdfc14a860 0x7fcdfc14c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fce01e52640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc14bfe0 con 0x7fcdfc0bc310 2023-06-23T18:50:36.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fce01e52640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0bbf90 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fce01e52640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc14ac60 con 0x7fcdfc14a860 2023-06-23T18:50:36.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37230/0 (socket says 172.21.15.38:37230) 2023-06-23T18:50:36.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/2686607477 learned_addr learned my addr 172.21.15.38:0/2686607477 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:36.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfbfff640 1 --2- 172.21.15.38:0/2686607477 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc14a860 0x7fcdfc14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/2686607477 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc14a860 msgr2=0x7fcdfc14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 --2- 172.21.15.38:0/2686607477 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc14a860 0x7fcdfc14c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/2686607477 >> v1:172.21.15.81:6789/0 conn(0x7fcdfc0bc310 legacy=0x7fcdfc14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/2686607477 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc14ba20 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfb7fe640 1 --2- 172.21.15.38:0/2686607477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0a5dd0 tx=0x7fcdec01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd743c913ecd4ae server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfa7fc640 1 -- 172.21.15.38:0/2686607477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00b2d0 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfa7fc640 1 -- 172.21.15.38:0/2686607477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec00b430 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:35.999+0000 7fcdfa7fc640 1 -- 172.21.15.38:0/2686607477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec0a7c20 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/2686607477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 msgr2=0x7fcdfc0bba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- 172.21.15.38:0/2686607477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0a5dd0 tx=0x7fcdec01eb10 comp rx=0 tx=0).stop 2023-06-23T18:50:36.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/2686607477 shutdown_connections 2023-06-23T18:50:36.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- 172.21.15.38:0/2686607477 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc14a860 0x7fcdfc14c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- 172.21.15.38:0/2686607477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc0bba50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/2686607477 >> 172.21.15.38:0/2686607477 conn(0x7fcdfc0bfe30 msgr2=0x7fcdfc0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/2686607477 shutdown_connections 2023-06-23T18:50:36.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/2686607477 wait complete. 2023-06-23T18:50:36.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 Processor -- start 2023-06-23T18:50:36.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- start start 2023-06-23T18:50:36.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0bc310 0x7fcdfc1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc14a860 0x7fcdfc139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc144860 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1e15f0 con 0x7fcdfc0bc310 2023-06-23T18:50:36.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1444f0 con 0x7fcdfc14a860 2023-06-23T18:50:36.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37242/0 (socket says 172.21.15.38:37242) 2023-06-23T18:50:36.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/4254021371 learned_addr learned my addr 172.21.15.38:0/4254021371 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:36.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc14a860 msgr2=0x7fcdfc139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc14a860 0x7fcdfc139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0bc310 msgr2=0x7fcdfc1395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0bc310 0x7fcdfc1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 -- 172.21.15.38:0/4254021371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec00bd40 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcdfb7fe640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcdec01b720 tx=0x7fcdec01b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec009800 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec009980 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec009d30 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc13dbb0 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.003+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc143950 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc144680 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdec0ba470 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fcde3fff640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 0x7fcde8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdec1218b0 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fcdfaffd640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 0x7fcde8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.007+0000 7fcdfaffd640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 0x7fcde8068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0000f70 tx=0x7fcdf00079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.011+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcdec0eead0 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.163+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdfc04d790 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.163+0000 7fcde3fff640 1 -- 172.21.15.38:0/4254021371 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdec0f20f0 con 0x7fcdfc06c4b0 2023-06-23T18:50:36.174 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 msgr2=0x7fcde8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 0x7fcde8068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0000f70 tx=0x7fcdf00079c0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 msgr2=0x7fcdfc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcdec01b720 tx=0x7fcdec01b8b0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 shutdown_connections 2023-06-23T18:50:36.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcde8066280 0x7fcde8068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc14a860 0x7fcdfc139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0bc310 0x7fcdfc1395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 --2- 172.21.15.38:0/4254021371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdfc06c4b0 0x7fcdfc06ef50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 >> 172.21.15.38:0/4254021371 conn(0x7fcdfc0bfe30 msgr2=0x7fcdfc0c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 shutdown_connections 2023-06-23T18:50:36.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.167+0000 7fce01e52640 1 -- 172.21.15.38:0/4254021371 wait complete. 2023-06-23T18:50:36.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:50:36.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.295+0000 7f4403a6d640 1 Processor -- start 2023-06-23T18:50:36.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.295+0000 7f4403a6d640 1 -- start start 2023-06-23T18:50:36.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f43fc0b7340 0x7f43fc06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc14e430 con 0x7f43fc0b6d00 2023-06-23T18:50:36.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc14e710 con 0x7f43fc14a360 2023-06-23T18:50:36.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc14f2b0 con 0x7f43fc0b7340 2023-06-23T18:50:36.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401809640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f43fc0b7340 0x7f43fc06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401008640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f43fc0b6d00 0x7f43fc14eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46080/0 (socket says 172.21.15.38:46080) 2023-06-23T18:50:36.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401008640 1 -- 172.21.15.38:0/4049076211 learned_addr learned my addr 172.21.15.38:0/4049076211 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:36.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401809640 1 -- 172.21.15.38:0/4049076211 >> v1:172.21.15.81:6789/0 conn(0x7f43fc14a360 legacy=0x7f43fc14a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4400807640 1 -- 172.21.15.38:0/4049076211 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762607145 0 0) 0x7f43fc14e430 con 0x7f43fc0b6d00 2023-06-23T18:50:36.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401809640 1 -- 172.21.15.38:0/4049076211 >> v1:172.21.15.38:6789/0 conn(0x7f43fc0b6d00 legacy=0x7f43fc14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401809640 1 -- 172.21.15.38:0/4049076211 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc14b090 con 0x7f43fc0b7340 2023-06-23T18:50:36.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4401809640 1 --2- 172.21.15.38:0/4049076211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc06c2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097c0 tx=0x7f43f801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab11c30509f0ab1c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4400807640 1 -- 172.21.15.38:0/4049076211 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80ab600 con 0x7f43fc0b7340 2023-06-23T18:50:36.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4400807640 1 -- 172.21.15.38:0/4049076211 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f80a7050 con 0x7f43fc0b7340 2023-06-23T18:50:36.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4400807640 1 -- 172.21.15.38:0/4049076211 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80ab980 con 0x7f43fc0b7340 2023-06-23T18:50:36.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- 172.21.15.38:0/4049076211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 msgr2=0x7f43fc06c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 --2- 172.21.15.38:0/4049076211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc06c2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097c0 tx=0x7f43f801c320 comp rx=0 tx=0).stop 2023-06-23T18:50:36.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- 172.21.15.38:0/4049076211 shutdown_connections 2023-06-23T18:50:36.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 --2- 172.21.15.38:0/4049076211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc06c2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- 172.21.15.38:0/4049076211 >> 172.21.15.38:0/4049076211 conn(0x7f43fc0c0f40 msgr2=0x7f43fc0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- 172.21.15.38:0/4049076211 shutdown_connections 2023-06-23T18:50:36.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.299+0000 7f4403a6d640 1 -- 172.21.15.38:0/4049076211 wait complete. 2023-06-23T18:50:36.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 Processor -- start 2023-06-23T18:50:36.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- start start 2023-06-23T18:50:36.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 0x7f43fc0befa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc1384c0 0x7f43fc13f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1e2d50 con 0x7f43fc0b7340 2023-06-23T18:50:36.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1e32b0 con 0x7f43fc1384c0 2023-06-23T18:50:36.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0bf4e0 con 0x7f43fc14a360 2023-06-23T18:50:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37252/0 (socket says 172.21.15.38:37252) 2023-06-23T18:50:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 -- 172.21.15.38:0/2638327109 learned_addr learned my addr 172.21.15.38:0/2638327109 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401008640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 0x7f43fc0befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 -- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 msgr2=0x7f43fc0befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 0x7f43fc0befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 -- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc1384c0 msgr2=0x7f43fc13f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f440200a640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc1384c0 0x7f43fc13f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc1384c0 0x7f43fc13f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 -- 172.21.15.38:0/2638327109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f8009420 con 0x7f43fc0b7340 2023-06-23T18:50:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401008640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 0x7f43fc0befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4401809640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097c0 tx=0x7f43f801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80b7650 con 0x7f43fc0b7340 2023-06-23T18:50:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f80abe90 con 0x7f43fc0b7340 2023-06-23T18:50:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc146f20 con 0x7f43fc0b7340 2023-06-23T18:50:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80b7a10 con 0x7f43fc0b7340 2023-06-23T18:50:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc13fa10 con 0x7f43fc0b7340 2023-06-23T18:50:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc139ef0 con 0x7f43fc0b7340 2023-06-23T18:50:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.303+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43f80b7b70 con 0x7f43fc0b7340 2023-06-23T18:50:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.307+0000 7f43f27fc640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 0x7f43e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.307+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f43f811e900 con 0x7f43fc0b7340 2023-06-23T18:50:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.307+0000 7f4401008640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 0x7f43e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.307+0000 7f4401008640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 0x7f43e0068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0c0f10 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.311+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43fc139ef0 con 0x7f43fc0b7340 2023-06-23T18:50:36.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43fc139ef0 con 0x7f43fc0b7340 2023-06-23T18:50:36.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f43f27fc640 1 -- 172.21.15.38:0/2638327109 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43f80bb020 con 0x7f43fc0b7340 2023-06-23T18:50:36.468 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-06-23T18:50:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 msgr2=0x7f43e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 0x7f43e0068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0c0f10 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2023-06-23T18:50:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 msgr2=0x7f43fc1399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097c0 tx=0x7f43f801ab60 comp rx=0 tx=0).stop 2023-06-23T18:50:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 shutdown_connections 2023-06-23T18:50:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f43e00662b0 0x7f43e0068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43fc1384c0 0x7f43fc13f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f43fc14a360 0x7f43fc0befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 --2- 172.21.15.38:0/2638327109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43fc0b7340 0x7f43fc1399b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 >> 172.21.15.38:0/2638327109 conn(0x7f43fc0c0f40 msgr2=0x7f43fc072900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 shutdown_connections 2023-06-23T18:50:36.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.459+0000 7f4403a6d640 1 -- 172.21.15.38:0/2638327109 wait complete. 2023-06-23T18:50:36.485 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-23T18:50:36.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 Processor -- start 2023-06-23T18:50:36.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 -- start start 2023-06-23T18:50:36.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff06c06c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff06c06c790 0x7ff06c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c0ba260 con 0x7ff06c137320 2023-06-23T18:50:36.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0bbed0 con 0x7ff06c06c790 2023-06-23T18:50:36.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff071c2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b9350 con 0x7ff06c0bb920 2023-06-23T18:50:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff06c137320 0x7ff06c0b9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46086/0 (socket says 172.21.15.38:46086) 2023-06-23T18:50:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 -- 172.21.15.38:0/2612657794 learned_addr learned my addr 172.21.15.38:0/2612657794 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06affd640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff06c06c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671038405 0 0) 0x7ff06c0ba260 con 0x7ff06c137320 2023-06-23T18:50:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06bfff640 1 --2- 172.21.15.38:0/2612657794 >> v2:172.21.15.81:3300/0 conn(0x7ff06c06c790 0x7ff06c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff054003530 con 0x7ff06c137320 2023-06-23T18:50:36.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906349677 0 0) 0x7ff054003530 con 0x7ff06c137320 2023-06-23T18:50:36.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 msgr2=0x7ff06c06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff06c06c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 >> v2:172.21.15.81:3300/0 conn(0x7ff06c06c790 msgr2=0x7ff06c14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 --2- 172.21.15.38:0/2612657794 >> v2:172.21.15.81:3300/0 conn(0x7ff06c06c790 0x7ff06c14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0b9630 con 0x7ff06c137320 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7ff064001a00 con 0x7ff06c137320 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 >> v1:172.21.15.38:6789/0 conn(0x7ff06c137320 legacy=0x7ff06c0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff054003980 0x7ff054003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0540043b0 0x7ff054004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff054005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0bbed0 con 0x7ff054003980 2023-06-23T18:50:36.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b9350 con 0x7ff0540043b0 2023-06-23T18:50:36.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05400ba10 con 0x7ff06c0bb920 2023-06-23T18:50:36.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06bfff640 1 --2- 172.21.15.38:0/2612657794 >> v2:172.21.15.81:3300/0 conn(0x7ff06c06c790 0x7ff06c14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:36.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff054003980 0x7ff054003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06affd640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0540043b0 0x7ff054004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06bfff640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff054005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 -- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 msgr2=0x7ff054005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c0bb920 0x7ff054005090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 -- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0540043b0 msgr2=0x7ff054004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0540043b0 0x7ff054004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06b7fe640 1 -- 172.21.15.38:0/2612657794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054003530 con 0x7ff054003980 2023-06-23T18:50:36.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.603+0000 7ff06affd640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0540043b0 0x7ff054004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:36.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff054003980 0x7ff054003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a830 tx=0x7ff06401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659662ce5209a9fe server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640ad630 con 0x7ff054003980 2023-06-23T18:50:36.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0640a8070 con 0x7ff054003980 2023-06-23T18:50:36.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06a7fc640 1 -- 172.21.15.38:0/2612657794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640ad9f0 con 0x7ff054003980 2023-06-23T18:50:36.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- 172.21.15.38:0/2612657794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff054003980 msgr2=0x7ff054003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 --2- 172.21.15.38:0/2612657794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff054003980 0x7ff054003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a830 tx=0x7ff06401d360 comp rx=0 tx=0).stop 2023-06-23T18:50:36.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 -- 172.21.15.38:0/2612657794 reap_dead start 2023-06-23T18:50:36.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- 172.21.15.38:0/2612657794 shutdown_connections 2023-06-23T18:50:36.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- 172.21.15.38:0/2612657794 >> 172.21.15.38:0/2612657794 conn(0x7ff06c0bfe30 msgr2=0x7ff06c0c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- 172.21.15.38:0/2612657794 shutdown_connections 2023-06-23T18:50:36.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- 172.21.15.38:0/2612657794 wait complete. 2023-06-23T18:50:36.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 Processor -- start 2023-06-23T18:50:36.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- start start 2023-06-23T18:50:36.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 0x7ff06c1e6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 0x7ff06c1e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c153270 con 0x7ff06c1e6c90 2023-06-23T18:50:36.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c152a80 con 0x7ff06c148760 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff071c2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c1520c0 con 0x7ff06c14d340 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37268/0 (socket says 172.21.15.38:37268) 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 -- 172.21.15.38:0/329576224 learned_addr learned my addr 172.21.15.38:0/329576224 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 0x7ff06c1e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06affd640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 0x7ff06c1e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 -- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 msgr2=0x7ff06c1e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 0x7ff06c1e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 -- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 msgr2=0x7ff06c1e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 0x7ff06c1e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06bfff640 1 -- 172.21.15.38:0/329576224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c152cd0 con 0x7ff06c1e6c90 2023-06-23T18:50:36.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06affd640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 0x7ff06c1e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:36.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.607+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 0x7ff06c1e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:36.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff06bfff640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0c0f30 tx=0x7ff05c00f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c00f9a0 con 0x7ff06c1e6c90 2023-06-23T18:50:36.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c00c030 con 0x7ff06c1e6c90 2023-06-23T18:50:36.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c00fd20 con 0x7ff06c1e6c90 2023-06-23T18:50:36.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c152550 con 0x7ff06c1e6c90 2023-06-23T18:50:36.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c154450 con 0x7ff06c1e6c90 2023-06-23T18:50:36.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c152230 con 0x7ff06c1e6c90 2023-06-23T18:50:36.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff05c014480 con 0x7ff06c1e6c90 2023-06-23T18:50:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 0x7ff058068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff05c083650 con 0x7ff06c1e6c90 2023-06-23T18:50:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 0x7ff058068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.611+0000 7ff06b7fe640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 0x7ff058068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a830 tx=0x7ff064007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.615+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff05c050740 con 0x7ff06c1e6c90 2023-06-23T18:50:36.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.763+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff06c04d790 con 0x7ff06c1e6c90 2023-06-23T18:50:36.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.763+0000 7ff053fff640 1 -- 172.21.15.38:0/329576224 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff05c053d60 con 0x7ff06c1e6c90 2023-06-23T18:50:36.774 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-06-23T18:50:36.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 msgr2=0x7ff058068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 0x7ff058068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff06400a830 tx=0x7ff064007040 comp rx=0 tx=0).stop 2023-06-23T18:50:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 msgr2=0x7ff06c1e97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0c0f30 tx=0x7ff05c00f1e0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 shutdown_connections 2023-06-23T18:50:36.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7ff0580662b0 0x7ff058068760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff06c1e6c90 0x7ff06c1e97b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c148760 0x7ff06c1e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 --2- 172.21.15.38:0/329576224 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff06c14d340 0x7ff06c1e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 >> 172.21.15.38:0/329576224 conn(0x7ff06c0bfe30 msgr2=0x7ff06c14c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 shutdown_connections 2023-06-23T18:50:36.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.767+0000 7ff071c2b640 1 -- 172.21.15.38:0/329576224 wait complete. 2023-06-23T18:50:36.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:50:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 Processor -- start 2023-06-23T18:50:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 -- start start 2023-06-23T18:50:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92b806c140 0x7f92b80bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b806c5c0 con 0x7f92b806bd10 2023-06-23T18:50:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b806b830 con 0x7f92b814b360 2023-06-23T18:50:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92c04d4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b8151ea0 con 0x7f92b806c140 2023-06-23T18:50:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bda6f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f92b806bd10 0x7f92b80bb320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46096/0 (socket says 172.21.15.38:46096) 2023-06-23T18:50:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bda6f640 1 -- 172.21.15.38:0/27342718 learned_addr learned my addr 172.21.15.38:0/27342718 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 --2- 172.21.15.38:0/27342718 >> v2:172.21.15.81:3300/0 conn(0x7f92b806c140 0x7f92b80bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125114479 0 0) 0x7f92b806c5c0 con 0x7f92b806bd10 2023-06-23T18:50:36.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a4003530 con 0x7f92b806bd10 2023-06-23T18:50:36.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789649094 0 0) 0x7f92a4003530 con 0x7f92b806bd10 2023-06-23T18:50:36.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 >> v2:172.21.15.81:3300/0 conn(0x7f92b806c140 msgr2=0x7f92b80bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 --2- 172.21.15.38:0/27342718 >> v2:172.21.15.81:3300/0 conn(0x7f92b806c140 0x7f92b80bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 >> v1:172.21.15.81:6789/0 conn(0x7f92b814b360 legacy=0x7f92b814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8152180 con 0x7f92b806bd10 2023-06-23T18:50:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f92a8001680 con 0x7f92b806bd10 2023-06-23T18:50:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 >> v1:172.21.15.38:6789/0 conn(0x7f92b806bd10 legacy=0x7f92b80bb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4003980 0x7f92a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a40047d0 0x7f92a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 0x7f92a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8151ea0 con 0x7f92a4005180 2023-06-23T18:50:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400c090 con 0x7f92a4003980 2023-06-23T18:50:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400c250 con 0x7f92a40047d0 2023-06-23T18:50:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 0x7f92a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92be270640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4003980 0x7f92a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 -- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a40047d0 msgr2=0x7f92a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a40047d0 0x7f92a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 -- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4003980 msgr2=0x7f92a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4003980 0x7f92a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.903+0000 7f92bea71640 1 -- 172.21.15.38:0/27342718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4003530 con 0x7f92a4005180 2023-06-23T18:50:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bea71640 1 -- 172.21.15.38:0/27342718 reap_dead start 2023-06-23T18:50:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bea71640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 0x7f92a400b990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009fc0 tx=0x7f92b001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb5d12f2c9b3b50 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00a5cb0 con 0x7f92a4005180 2023-06-23T18:50:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b000f040 con 0x7f92a4005180 2023-06-23T18:50:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bd26e640 1 -- 172.21.15.38:0/27342718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003be0 con 0x7f92a4005180 2023-06-23T18:50:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 msgr2=0x7f92a400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 0x7f92a400b990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009fc0 tx=0x7f92b001cca0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- 172.21.15.38:0/27342718 shutdown_connections 2023-06-23T18:50:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 --2- 172.21.15.38:0/27342718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92a4005180 0x7f92a400b990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- 172.21.15.38:0/27342718 >> 172.21.15.38:0/27342718 conn(0x7f92b80c1fb0 msgr2=0x7f92b80c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- 172.21.15.38:0/27342718 shutdown_connections 2023-06-23T18:50:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- 172.21.15.38:0/27342718 wait complete. 2023-06-23T18:50:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 Processor -- start 2023-06-23T18:50:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- start start 2023-06-23T18:50:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4005180 0x7f92b814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92b8133a70 0x7f92b80bc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b814d7a0 con 0x7f92b80bda10 2023-06-23T18:50:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80bfdb0 con 0x7f92a4005180 2023-06-23T18:50:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92c04d4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80bf410 con 0x7f92b8133a70 2023-06-23T18:50:36.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bea71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bea71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37274/0 (socket says 172.21.15.38:37274) 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.907+0000 7f92bea71640 1 -- 172.21.15.38:0/1477521826 learned_addr learned my addr 172.21.15.38:0/1477521826 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bda6f640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92b8133a70 0x7f92b80bc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92be270640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4005180 0x7f92b814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 -- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92b8133a70 msgr2=0x7f92b80bc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92b8133a70 0x7f92b80bc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 -- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4005180 msgr2=0x7f92b814d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4005180 0x7f92b814d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 -- 172.21.15.38:0/1477521826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80bf6f0 con 0x7f92b80bda10 2023-06-23T18:50:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92bea71640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f92b00987d0 tx=0x7f92b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003ba0 con 0x7f92b80bda10 2023-06-23T18:50:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0003d20 con 0x7f92b80bda10 2023-06-23T18:50:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b80bc6f0 con 0x7f92b80bda10 2023-06-23T18:50:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0004270 con 0x7f92b80bda10 2023-06-23T18:50:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b80c09c0 con 0x7f92b80bda10 2023-06-23T18:50:36.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b804d790 con 0x7f92b80bda10 2023-06-23T18:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92b00043d0 con 0x7f92b80bda10 2023-06-23T18:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 0x7f929c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f92b00a6e40 con 0x7f92b80bda10 2023-06-23T18:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92be270640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 0x7f929c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.911+0000 7f92be270640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 0x7f929c068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005490 tx=0x7f92b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:36.915+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92b00ebb30 con 0x7f92b80bda10 2023-06-23T18:50:37.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.075+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92b814c2f0 con 0x7f92b80bda10 2023-06-23T18:50:37.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.075+0000 7f92aeffd640 1 -- 172.21.15.38:0/1477521826 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92b00bc020 con 0x7f92b80bda10 2023-06-23T18:50:37.085 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-06-23T18:50:37.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 msgr2=0x7f929c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:37.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 0x7f929c068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005490 tx=0x7f92b4009040 comp rx=0 tx=0).stop 2023-06-23T18:50:37.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 msgr2=0x7f92b80c02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:37.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f92b00987d0 tx=0x7f92b0009750 comp rx=0 tx=0).stop 2023-06-23T18:50:37.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 shutdown_connections 2023-06-23T18:50:37.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f929c0662b0 0x7f929c068760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:37.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92b80bda10 0x7f92b80c02b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:37.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92b8133a70 0x7f92b80bc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:37.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 --2- 172.21.15.38:0/1477521826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a4005180 0x7f92b814d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:37.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 >> 172.21.15.38:0/1477521826 conn(0x7f92b80c1fb0 msgr2=0x7f92b81345c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:37.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 shutdown_connections 2023-06-23T18:50:37.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:37.079+0000 7f92c04d4640 1 -- 172.21.15.38:0/1477521826 wait complete. 2023-06-23T18:50:37.102 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi192.front.sepia.ceph.com... 2023-06-23T18:50:37.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.103 DEBUG:teuthology.orchestra.run.smithi192:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-06-23T18:50:37.122 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi192.stderr:ceph-fuse[32772]: fuse finished with error 0 and tester_r 0 2023-06-23T18:50:37.124 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:50:37.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T18:50:37.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.207 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-23T18:50:37.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.220 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2023-06-23T18:50:37.226 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-23T18:50:37.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-23T18:50:37.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2023-06-23T18:50:37.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.456 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-06-23T18:50:37.462 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2023-06-23T18:50:37.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.462 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-23T18:50:37.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.517 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-06-23T18:50:37.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.694 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-06-23T18:50:37.700 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-23T18:50:37.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T18:50:37.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:50:37.757 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-06-23T18:50:37.925 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-23T18:50:37.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-23T18:50:37.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:50:38.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.063+0000 7f0625e2c640 1 Processor -- start 2023-06-23T18:50:38.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.063+0000 7f0625e2c640 1 -- start start 2023-06-23T18:50:38.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f0625e2c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f062006c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f0625e2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06200bd1e0 0x7f0620070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f0625e2c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200ba9d0 con 0x7f062006c9b0 2023-06-23T18:50:38.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f0625e2c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200bc300 con 0x7f06200bd1e0 2023-06-23T18:50:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f0625e2c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06200a5570 con 0x7f062014b930 2023-06-23T18:50:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f062006c9b0 0x7f06200707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46098/0 (socket says 172.21.15.38:46098) 2023-06-23T18:50:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 -- 172.21.15.38:0/1048598200 learned_addr learned my addr 172.21.15.38:0/1048598200 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f062006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061effd640 1 --2- 172.21.15.38:0/1048598200 >> v2:172.21.15.81:3300/0 conn(0x7f06200bd1e0 0x7f0620070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910698904 0 0) 0x7f06200ba9d0 con 0x7f062006c9b0 2023-06-23T18:50:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0608003530 con 0x7f062006c9b0 2023-06-23T18:50:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4194196361 0 0) 0x7f0608003530 con 0x7f062006c9b0 2023-06-23T18:50:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 msgr2=0x7f062006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f062006c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 >> v2:172.21.15.81:3300/0 conn(0x7f06200bd1e0 msgr2=0x7f0620070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 --2- 172.21.15.38:0/1048598200 >> v2:172.21.15.81:3300/0 conn(0x7f06200bd1e0 0x7f0620070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620150160 con 0x7f062006c9b0 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f0618001a00 con 0x7f062006c9b0 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 >> v1:172.21.15.38:6789/0 conn(0x7f062006c9b0 legacy=0x7f06200707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f0608003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608003f00 0x7f06080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0608004d10 0x7f0608005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200bc300 con 0x7f0608004d10 2023-06-23T18:50:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200a5570 con 0x7f0608003f00 2023-06-23T18:50:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060800b990 con 0x7f062014b930 2023-06-23T18:50:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0608004d10 0x7f0608005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f0608003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061effd640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608003f00 0x7f06080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 -- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 msgr2=0x7f0608003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062014b930 0x7f0608003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 -- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608003f00 msgr2=0x7f06080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608003f00 0x7f06080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061ffff640 1 -- 172.21.15.38:0/1048598200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608003530 con 0x7f0608004d10 2023-06-23T18:50:38.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.067+0000 7f061effd640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608003f00 0x7f06080047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061ffff640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0608004d10 0x7f0608005180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f061800a8d0 tx=0x7f061801d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a5bc0a79248627 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180ad630 con 0x7f0608004d10 2023-06-23T18:50:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180a8070 con 0x7f0608004d10 2023-06-23T18:50:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061e7fc640 1 -- 172.21.15.38:0/1048598200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180ad9d0 con 0x7f0608004d10 2023-06-23T18:50:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1048598200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0608004d10 msgr2=0x7f0608005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1048598200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0608004d10 0x7f0608005180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f061800a8d0 tx=0x7f061801d3e0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061ffff640 1 -- 172.21.15.38:0/1048598200 reap_dead start 2023-06-23T18:50:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1048598200 shutdown_connections 2023-06-23T18:50:38.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1048598200 >> 172.21.15.38:0/1048598200 conn(0x7f06200c0c90 msgr2=0x7f06200bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1048598200 shutdown_connections 2023-06-23T18:50:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1048598200 wait complete. 2023-06-23T18:50:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 Processor -- start 2023-06-23T18:50:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- start start 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 0x7f0620149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06200b71e0 0x7f06201e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200b6a70 con 0x7f0620148940 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200b6d50 con 0x7f0608004d10 2023-06-23T18:50:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620149fa0 con 0x7f06200b71e0 2023-06-23T18:50:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37302/0 (socket says 172.21.15.38:37302) 2023-06-23T18:50:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 -- 172.21.15.38:0/1692457074 learned_addr learned my addr 172.21.15.38:0/1692457074 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061ffff640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06200b71e0 0x7f06201e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 0x7f0620149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 -- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06200b71e0 msgr2=0x7f06201e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06200b71e0 0x7f06201e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 -- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 msgr2=0x7f0620149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 0x7f0620149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 -- 172.21.15.38:0/1692457074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620148590 con 0x7f0620148940 2023-06-23T18:50:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 0x7f0620149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f061effd640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06140109b0 tx=0x7f0614010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400ec20 con 0x7f0620148940 2023-06-23T18:50:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400ed80 con 0x7f0620148940 2023-06-23T18:50:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614004220 con 0x7f0620148940 2023-06-23T18:50:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062014a380 con 0x7f0620148940 2023-06-23T18:50:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.071+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06200b64f0 con 0x7f0620148940 2023-06-23T18:50:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062004d790 con 0x7f0620148940 2023-06-23T18:50:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0614004380 con 0x7f0620148940 2023-06-23T18:50:38.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f0607fff640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 0x7f060c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06140846c0 con 0x7f0620148940 2023-06-23T18:50:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 0x7f060c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.075+0000 7f061f7fe640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 0x7f060c068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0610009a20 tx=0x7f0610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.079+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06140519c0 con 0x7f0620148940 2023-06-23T18:50:38.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.223+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f062014ec10 con 0x7f060c0662b0 2023-06-23T18:50:38.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.255+0000 7f0607fff640 1 -- 172.21.15.38:0/1692457074 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390729 (secure 0 0 0) 0x7f0610012950 con 0x7f060c0662b0 2023-06-23T18:50:38.267 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:38.270 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:50:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 msgr2=0x7f060c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 0x7f060c068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0610009a20 tx=0x7f0610008040 comp rx=0 tx=0).stop 2023-06-23T18:50:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 msgr2=0x7f062014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06140109b0 tx=0x7f0614010e70 comp rx=0 tx=0).stop 2023-06-23T18:50:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 shutdown_connections 2023-06-23T18:50:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f060c0662b0 0x7f060c068760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06200b71e0 0x7f06201e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0620148940 0x7f062014e500 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 --2- 172.21.15.38:0/1692457074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0608004d10 0x7f0620149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 >> 172.21.15.38:0/1692457074 conn(0x7f06200c0c90 msgr2=0x7f06200be190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 shutdown_connections 2023-06-23T18:50:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.259+0000 7f0625e2c640 1 -- 172.21.15.38:0/1692457074 wait complete. 2023-06-23T18:50:38.284 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-06-23T18:50:37.272858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596561,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230408,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744312,"statfs":{"total":773094113280,"available":772858175488,"internally_reserved":0,"allocated":2564096,"data_stored":2162178,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005506"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'16","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:21.973615+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:50:21.973615+0000","last_peered":"2023-06-23T18:50:21.973615+0000","last_clean":"2023-06-23T18:50:21.973615+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:50:21.973615+0000","last_undegraded":"2023-06-23T18:50:21.973615+0000","last_fullsized":"2023-06-23T18:50:21.973615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6193,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.069}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.014},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.877}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.0620000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":126631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.31}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.5}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.753}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.62}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.37}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.874}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84199999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.309}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.374},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.748},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.61799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.242}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.87},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.175},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.288}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.573},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.387}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.649},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76800000000000002}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.034}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:50:38.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:50:38.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.435+0000 7eff742a3640 1 Processor -- start 2023-06-23T18:50:38.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.435+0000 7eff742a3640 1 -- start start 2023-06-23T18:50:38.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff6c06c6d0 0x7eff6c070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c0bd9b0 0x7eff6c0a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff6c0bc4f0 0x7eff6c14a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0b9ca0 con 0x7eff6c06c6d0 2023-06-23T18:50:38.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0714a0 con 0x7eff6c0bc4f0 2023-06-23T18:50:38.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff742a3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06a3f0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff6c06c6d0 0x7eff6c070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff6c06c6d0 0x7eff6c070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37314/0 (socket says 172.21.15.38:37314) 2023-06-23T18:50:38.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 -- 172.21.15.38:0/4156695342 learned_addr learned my addr 172.21.15.38:0/4156695342 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:38.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7183e640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c0bd9b0 0x7eff6c0a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff72840640 1 --2- 172.21.15.38:0/4156695342 >> v2:172.21.15.81:3300/0 conn(0x7eff6c0bc4f0 0x7eff6c14a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 -- 172.21.15.38:0/4156695342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c0bd9b0 msgr2=0x7eff6c0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c0bd9b0 0x7eff6c0a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 -- 172.21.15.38:0/4156695342 >> v2:172.21.15.81:3300/0 conn(0x7eff6c0bc4f0 msgr2=0x7eff6c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 --2- 172.21.15.38:0/4156695342 >> v2:172.21.15.81:3300/0 conn(0x7eff6c0bc4f0 0x7eff6c14a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 -- 172.21.15.38:0/4156695342 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0ba390 con 0x7eff6c06c6d0 2023-06-23T18:50:38.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.439+0000 7eff7203f640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c06c6d0 0x7eff6c070f60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff6c070960 tx=0x7eff6801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cc23a77741b10a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7103d640 1 -- 172.21.15.38:0/4156695342 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680ad660 con 0x7eff6c06c6d0 2023-06-23T18:50:38.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7103d640 1 -- 172.21.15.38:0/4156695342 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff680ad7c0 con 0x7eff6c06c6d0 2023-06-23T18:50:38.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7103d640 1 -- 172.21.15.38:0/4156695342 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680adb50 con 0x7eff6c06c6d0 2023-06-23T18:50:38.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- 172.21.15.38:0/4156695342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c06c6d0 msgr2=0x7eff6c070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c06c6d0 0x7eff6c070f60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff6c070960 tx=0x7eff6801c470 comp rx=0 tx=0).stop 2023-06-23T18:50:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- 172.21.15.38:0/4156695342 shutdown_connections 2023-06-23T18:50:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- 172.21.15.38:0/4156695342 >> v2:172.21.15.81:3300/0 conn(0x7eff6c0bc4f0 0x7eff6c14a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c0bd9b0 0x7eff6c0a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- 172.21.15.38:0/4156695342 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c06c6d0 0x7eff6c070f60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- 172.21.15.38:0/4156695342 >> 172.21.15.38:0/4156695342 conn(0x7eff6c0c0c90 msgr2=0x7eff6c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- 172.21.15.38:0/4156695342 shutdown_connections 2023-06-23T18:50:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- 172.21.15.38:0/4156695342 wait complete. 2023-06-23T18:50:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 Processor -- start 2023-06-23T18:50:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- start start 2023-06-23T18:50:38.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c06c6d0 0x7eff6c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 0x7eff6c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c14c540 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1431d0 con 0x7eff6c0bc4f0 2023-06-23T18:50:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff742a3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c141350 con 0x7eff6c06c6d0 2023-06-23T18:50:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37330/0 (socket says 172.21.15.38:37330) 2023-06-23T18:50:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 -- 172.21.15.38:0/4062368766 learned_addr learned my addr 172.21.15.38:0/4062368766 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7183e640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 0x7eff6c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7203f640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c06c6d0 0x7eff6c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 -- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c06c6d0 msgr2=0x7eff6c1540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c06c6d0 0x7eff6c1540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 -- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 msgr2=0x7eff6c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 0x7eff6c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff72840640 1 -- 172.21.15.38:0/4062368766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680094d0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.443+0000 7eff7183e640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 0x7eff6c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:38.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff72840640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7eff64007d20 tx=0x7eff6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64014420 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff640145a0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c1419b0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64014950 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c149db0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c143010 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff64014ab0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 0x7eff50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff640847e0 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff7203f640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 0x7eff50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.447+0000 7eff7203f640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 0x7eff50068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff680af000 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.451+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff64051a00 con 0x7eff6c0bd9b0 2023-06-23T18:50:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.599+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff6c0a53e0 con 0x7eff50066280 2023-06-23T18:50:38.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.631+0000 7eff62ffd640 1 -- 172.21.15.38:0/4062368766 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390729 (secure 0 0 0) 0x7eff680ad560 con 0x7eff50066280 2023-06-23T18:50:38.642 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:50:38.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 msgr2=0x7eff50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 0x7eff50068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff680af000 tx=0x7eff68008040 comp rx=0 tx=0).stop 2023-06-23T18:50:38.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 msgr2=0x7eff6c1482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7eff64007d20 tx=0x7eff6400e4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 shutdown_connections 2023-06-23T18:50:38.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7eff50066280 0x7eff50068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff6c0bd9b0 0x7eff6c1482b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c0bc4f0 0x7eff6c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 --2- 172.21.15.38:0/4062368766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff6c06c6d0 0x7eff6c1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 >> 172.21.15.38:0/4062368766 conn(0x7eff6c0c0c90 msgr2=0x7eff6c0bcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 shutdown_connections 2023-06-23T18:50:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.635+0000 7eff742a3640 1 -- 172.21.15.38:0/4062368766 wait complete. 2023-06-23T18:50:38.661 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-06-23T18:50:37.272858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596561,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230408,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744312,"statfs":{"total":773094113280,"available":772858175488,"internally_reserved":0,"allocated":2564096,"data_stored":2162178,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005506"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'16","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:21.973615+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:50:21.973615+0000","last_peered":"2023-06-23T18:50:21.973615+0000","last_clean":"2023-06-23T18:50:21.973615+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:50:21.973615+0000","last_undegraded":"2023-06-23T18:50:21.973615+0000","last_fullsized":"2023-06-23T18:50:21.973615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6193,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.069}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.014},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.877}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.0620000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":126631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.31}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.5}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.753}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.62}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.37}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.874}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84199999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.309}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.374},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.748},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.61799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.242}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.87},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.175},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.288}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.573},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.387}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.649},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76800000000000002}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.034}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:50:38.670 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-23T18:50:38.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:50:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 Processor -- start 2023-06-23T18:50:38.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 -- start start 2023-06-23T18:50:38.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 0x7f07c814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07c80be560 0x7f07c814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c814ffe0 con 0x7f07c80b5e20 2023-06-23T18:50:38.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c814bfc0 con 0x7f07c80be560 2023-06-23T18:50:38.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07ce46f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8150260 con 0x7f07c80696d0 2023-06-23T18:50:38.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07cca0c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f07c80b5e20 0x7f07c80b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46100/0 (socket says 172.21.15.38:46100) 2023-06-23T18:50:38.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07cca0c640 1 -- 172.21.15.38:0/3841732956 learned_addr learned my addr 172.21.15.38:0/3841732956 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:38.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 0x7f07c814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326981206 0 0) 0x7f07c814ffe0 con 0x7f07c80b5e20 2023-06-23T18:50:38.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c77fe640 1 --2- 172.21.15.38:0/3841732956 >> v2:172.21.15.81:3300/0 conn(0x7f07c80be560 0x7f07c814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b4003530 con 0x7f07c80b5e20 2023-06-23T18:50:38.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866043301 0 0) 0x7f07b4003530 con 0x7f07c80b5e20 2023-06-23T18:50:38.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 msgr2=0x7f07c814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 0x7f07c814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 >> v2:172.21.15.81:3300/0 conn(0x7f07c80be560 msgr2=0x7f07c814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 --2- 172.21.15.38:0/3841732956 >> v2:172.21.15.81:3300/0 conn(0x7f07c80be560 0x7f07c814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c80b83c0 con 0x7f07c80b5e20 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f07b8001680 con 0x7f07c80b5e20 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 >> v1:172.21.15.38:6789/0 conn(0x7f07c80b5e20 legacy=0x7f07c80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07b4003980 0x7f07b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07b40047d0 0x7f07b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 0x7f07b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8150260 con 0x7f07b4003980 2023-06-23T18:50:38.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b400b990 con 0x7f07b40047d0 2023-06-23T18:50:38.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b400bb50 con 0x7f07c80696d0 2023-06-23T18:50:38.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07b4003980 0x7f07b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c77fe640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07b40047d0 0x7f07b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 -- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 msgr2=0x7f07b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07c80696d0 0x7f07b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 -- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07b40047d0 msgr2=0x7f07b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:38.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07b40047d0 0x7f07b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c7fff640 1 -- 172.21.15.38:0/3841732956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4003530 con 0x7f07b4003980 2023-06-23T18:50:38.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.815+0000 7f07c77fe640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07b40047d0 0x7f07b4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:38.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c7fff640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07b4003980 0x7f07b4003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009ae0 tx=0x7f07c001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9c5c7728890f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c00a5510 con 0x7f07b4003980 2023-06-23T18:50:38.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c00a5670 con 0x7f07b4003980 2023-06-23T18:50:38.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c6ffd640 1 -- 172.21.15.38:0/3841732956 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c00a5a20 con 0x7f07b4003980 2023-06-23T18:50:38.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- 172.21.15.38:0/3841732956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07b4003980 msgr2=0x7f07b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 --2- 172.21.15.38:0/3841732956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07b4003980 0x7f07b4003d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009ae0 tx=0x7f07c001ca90 comp rx=0 tx=0).stop 2023-06-23T18:50:38.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07cca0c640 1 -- 172.21.15.38:0/3841732956 reap_dead start 2023-06-23T18:50:38.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- 172.21.15.38:0/3841732956 shutdown_connections 2023-06-23T18:50:38.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- 172.21.15.38:0/3841732956 >> 172.21.15.38:0/3841732956 conn(0x7f07c80bd9a0 msgr2=0x7f07c80bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:38.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- 172.21.15.38:0/3841732956 shutdown_connections 2023-06-23T18:50:38.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- 172.21.15.38:0/3841732956 wait complete. 2023-06-23T18:50:38.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 Processor -- start 2023-06-23T18:50:38.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- start start 2023-06-23T18:50:38.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07b4003980 0x7f07c81e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 0x7f07c8152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c81559c0 con 0x7f07c8070860 2023-06-23T18:50:38.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8155370 con 0x7f07c80bd210 2023-06-23T18:50:38.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07ce46f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c81e76c0 con 0x7f07b4003980 2023-06-23T18:50:38.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37352/0 (socket says 172.21.15.38:37352) 2023-06-23T18:50:38.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 -- 172.21.15.38:0/966796724 learned_addr learned my addr 172.21.15.38:0/966796724 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:38.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c7fff640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07b4003980 0x7f07c81e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07cca0c640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 0x7f07c8152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 -- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07b4003980 msgr2=0x7f07c81e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07b4003980 0x7f07c81e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 -- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 msgr2=0x7f07c8152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:38.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 0x7f07c8152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:38.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07c77fe640 1 -- 172.21.15.38:0/966796724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c81555e0 con 0x7f07c8070860 2023-06-23T18:50:38.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.819+0000 7f07cca0c640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 0x7f07c8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:38.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c77fe640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f07b00101f0 tx=0x7f07b00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000e050 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000f040 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c814f620 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0010ee0 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c80a5810 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c8073720 con 0x7f07c8070860 2023-06-23T18:50:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07b0003bc0 con 0x7f07c8070860 2023-06-23T18:50:38.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 0x7f07a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:38.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07b00854a0 con 0x7f07c8070860 2023-06-23T18:50:38.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.823+0000 7f07c7fff640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 0x7f07a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:38.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.827+0000 7f07c7fff640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 0x7f07a8068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07c00af000 tx=0x7f07c00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:38.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.827+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07b0052710 con 0x7f07c8070860 2023-06-23T18:50:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:38.975+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07c814ce30 con 0x7f07a8066280 2023-06-23T18:50:39.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.007+0000 7f07c4ff9640 1 -- 172.21.15.38:0/966796724 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390729 (secure 0 0 0) 0x7f07c00bc090 con 0x7f07a8066280 2023-06-23T18:50:39.016 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:39.020 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:50:39.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 msgr2=0x7f07a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 0x7f07a8068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07c00af000 tx=0x7f07c00046d0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 msgr2=0x7f07c80bccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f07b00101f0 tx=0x7f07b00106b0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 shutdown_connections 2023-06-23T18:50:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f07a8066280 0x7f07a8068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c80bd210 0x7f07c8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c8070860 0x7f07c80bccd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 --2- 172.21.15.38:0/966796724 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07b4003980 0x7f07c81e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 >> 172.21.15.38:0/966796724 conn(0x7f07c80bd9a0 msgr2=0x7f07c80b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:39.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 shutdown_connections 2023-06-23T18:50:39.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.011+0000 7f07ce46f640 1 -- 172.21.15.38:0/966796724 wait complete. 2023-06-23T18:50:39.038 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-06-23T18:50:37.272858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596561,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230408,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744312,"statfs":{"total":773094113280,"available":772858175488,"internally_reserved":0,"allocated":2564096,"data_stored":2162178,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005506"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'16","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:21.973615+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:50:21.973615+0000","last_peered":"2023-06-23T18:50:21.973615+0000","last_clean":"2023-06-23T18:50:21.973615+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:50:21.973615+0000","last_undegraded":"2023-06-23T18:50:21.973615+0000","last_fullsized":"2023-06-23T18:50:21.973615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5395,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6193,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.069}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.014},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.877}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.0620000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":126631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.31}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.5}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.753}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.62}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.37}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.874}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.84199999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.309}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.374},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.748},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.61799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.242}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.87},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.175},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.288}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.573},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.387}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.649},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.4370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76800000000000002}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.034}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0800000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:50:39.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:50:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.191+0000 7f9ea3c38640 1 Processor -- start 2023-06-23T18:50:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.191+0000 7f9ea3c38640 1 -- start start 2023-06-23T18:50:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea3c38640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 0x7f9e9c14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea3c38640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0b9ca0 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea3c38640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c06a3f0 con 0x7f9e9c06c6d0 2023-06-23T18:50:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea3c38640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a55b0 con 0x7f9e9c0bc4f0 2023-06-23T18:50:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea11d3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9e9c0bd9b0 0x7f9e9c14a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46104/0 (socket says 172.21.15.38:46104) 2023-06-23T18:50:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea11d3640 1 -- 172.21.15.38:0/1581866269 learned_addr learned my addr 172.21.15.38:0/1581866269 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea21d5640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 0x7f9e9c14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106892966 0 0) 0x7f9e9c0b9ca0 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e88003530 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511209582 0 0) 0x7f9e88003530 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 msgr2=0x7f9e9c14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 0x7f9e9c14abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 >> v1:172.21.15.81:6789/0 conn(0x7f9e9c06c6d0 legacy=0x7f9e9c0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0ba390 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f9e98001680 con 0x7f9e9c0bd9b0 2023-06-23T18:50:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 >> v1:172.21.15.38:6789/0 conn(0x7f9e9c0bd9b0 legacy=0x7f9e9c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e880039b0 0x7f9e88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 0x7f9e880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e88004d10 0x7f9e88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a55b0 con 0x7f9e880039b0 2023-06-23T18:50:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8800dce0 con 0x7f9e88004d10 2023-06-23T18:50:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8800dea0 con 0x7f9e9c0bc4f0 2023-06-23T18:50:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e880039b0 0x7f9e88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea21d5640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e88004d10 0x7f9e88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 -- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 msgr2=0x7f9e880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c0bc4f0 0x7f9e880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 -- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e88004d10 msgr2=0x7f9e88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e88004d10 0x7f9e88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.195+0000 7f9ea19d4640 1 -- 172.21.15.38:0/1581866269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88003530 con 0x7f9e880039b0 2023-06-23T18:50:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e880039b0 0x7f9e88003dc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c001780 tx=0x7f9e8c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34452b92814b48c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0052d0 con 0x7f9e880039b0 2023-06-23T18:50:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0a7050 con 0x7f9e880039b0 2023-06-23T18:50:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea09d2640 1 -- 172.21.15.38:0/1581866269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c003600 con 0x7f9e880039b0 2023-06-23T18:50:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/1581866269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e880039b0 msgr2=0x7f9e88003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/1581866269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e880039b0 0x7f9e88003dc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c001780 tx=0x7f9e8c01c400 comp rx=0 tx=0).stop 2023-06-23T18:50:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea21d5640 1 -- 172.21.15.38:0/1581866269 reap_dead start 2023-06-23T18:50:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/1581866269 shutdown_connections 2023-06-23T18:50:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/1581866269 >> 172.21.15.38:0/1581866269 conn(0x7f9e9c0c0c90 msgr2=0x7f9e9c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/1581866269 shutdown_connections 2023-06-23T18:50:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/1581866269 wait complete. 2023-06-23T18:50:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 Processor -- start 2023-06-23T18:50:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- start start 2023-06-23T18:50:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880039b0 0x7f9e9c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 0x7f9e9c13a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c141720 con 0x7f9e9c1463c0 2023-06-23T18:50:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1468e0 con 0x7f9e880039b0 2023-06-23T18:50:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c06e7f0 con 0x7f9e9c149c70 2023-06-23T18:50:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37380/0 (socket says 172.21.15.38:37380) 2023-06-23T18:50:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 -- 172.21.15.38:0/2842341012 learned_addr learned my addr 172.21.15.38:0/2842341012 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880039b0 0x7f9e9c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea21d5640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 0x7f9e9c13a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 -- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 msgr2=0x7f9e9c13a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 0x7f9e9c13a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 -- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880039b0 msgr2=0x7f9e9c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880039b0 0x7f9e9c06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 -- 172.21.15.38:0/2842341012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c145530 con 0x7f9e9c1463c0 2023-06-23T18:50:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea21d5640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 0x7f9e9c13a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea11d3640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800c690 tx=0x7f9e9800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980072d0 con 0x7f9e9c1463c0 2023-06-23T18:50:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98007430 con 0x7f9e9c1463c0 2023-06-23T18:50:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c1458a0 con 0x7f9e9c1463c0 2023-06-23T18:50:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980047f0 con 0x7f9e9c1463c0 2023-06-23T18:50:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.199+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c13c920 con 0x7f9e9c1463c0 2023-06-23T18:50:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c145390 con 0x7f9e9c1463c0 2023-06-23T18:50:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e98004950 con 0x7f9e9c1463c0 2023-06-23T18:50:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9e927fc640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 0x7f9e80068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e980835b0 con 0x7f9e9c1463c0 2023-06-23T18:50:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 0x7f9e80068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.203+0000 7f9ea19d4640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 0x7f9e80068760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c001750 tx=0x7f9e8c0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:39.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.207+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e9c145390 con 0x7f9e9c1463c0 2023-06-23T18:50:39.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.363+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e9c149990 con 0x7f9e9c1463c0 2023-06-23T18:50:39.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.363+0000 7f9e927fc640 1 -- 172.21.15.38:0/2842341012 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7f9e9806be60 con 0x7f9e9c1463c0 2023-06-23T18:50:39.373 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:39.374 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:50:39.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 msgr2=0x7f9e80068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 0x7f9e80068760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c001750 tx=0x7f9e8c0011a0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 msgr2=0x7f9e9c13a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800c690 tx=0x7f9e9800cb50 comp rx=0 tx=0).stop 2023-06-23T18:50:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 shutdown_connections 2023-06-23T18:50:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9e800662b0 0x7f9e80068760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e9c149c70 0x7f9e9c13a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e9c1463c0 0x7f9e9c13a070 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 --2- 172.21.15.38:0/2842341012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880039b0 0x7f9e9c06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:39.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 >> 172.21.15.38:0/2842341012 conn(0x7f9e9c0c0c90 msgr2=0x7f9e9c0a4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:39.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 shutdown_connections 2023-06-23T18:50:39.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:39.367+0000 7f9ea3c38640 1 -- 172.21.15.38:0/2842341012 wait complete. 2023-06-23T18:50:40.393 INFO:tasks.ceph:Scrubbing osd.0 2023-06-23T18:50:40.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 Processor -- start 2023-06-23T18:50:40.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 -- start start 2023-06-23T18:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 0x7f0e240a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e240a30c0 0x7f0e240c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e24152830 con 0x7f0e240bee10 2023-06-23T18:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e240c22a0 con 0x7f0e240a30c0 2023-06-23T18:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e2aea8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e240c2870 con 0x7f0e240bea40 2023-06-23T18:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e240a30c0 0x7f0e240c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e240a30c0 0x7f0e240c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37384/0 (socket says 172.21.15.38:37384) 2023-06-23T18:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 -- 172.21.15.38:0/4153459117 learned_addr learned my addr 172.21.15.38:0/4153459117 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e28c44640 1 --2- 172.21.15.38:0/4153459117 >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 0x7f0e240a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 -- 172.21.15.38:0/4153459117 >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 msgr2=0x7f0e240a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 --2- 172.21.15.38:0/4153459117 >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 0x7f0e240a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 -- 172.21.15.38:0/4153459117 >> v1:172.21.15.81:6789/0 conn(0x7f0e240bee10 legacy=0x7f0e2406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e23fff640 1 -- 172.21.15.38:0/4153459117 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e240b7950 con 0x7f0e240a30c0 2023-06-23T18:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.523+0000 7f0e28c44640 1 --2- 172.21.15.38:0/4153459117 >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 0x7f0e240a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e23fff640 1 --2- 172.21.15.38:0/4153459117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240a30c0 0x7f0e240c0c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0e24071c20 tx=0x7f0e1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17e403c09609c4f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e237fe640 1 -- 172.21.15.38:0/4153459117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180ab600 con 0x7f0e240a30c0 2023-06-23T18:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e237fe640 1 -- 172.21.15.38:0/4153459117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180a7050 con 0x7f0e240a30c0 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e237fe640 1 -- 172.21.15.38:0/4153459117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180ab980 con 0x7f0e240a30c0 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 -- 172.21.15.38:0/4153459117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240a30c0 msgr2=0x7f0e240c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/4153459117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240a30c0 0x7f0e240c0c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0e24071c20 tx=0x7f0e1801c430 comp rx=0 tx=0).stop 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 -- 172.21.15.38:0/4153459117 shutdown_connections 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/4153459117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240a30c0 0x7f0e240c0c70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/4153459117 >> v2:172.21.15.81:3300/0 conn(0x7f0e240bea40 0x7f0e240a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 -- 172.21.15.38:0/4153459117 >> 172.21.15.38:0/4153459117 conn(0x7f0e240a5cc0 msgr2=0x7f0e240a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 -- 172.21.15.38:0/4153459117 shutdown_connections 2023-06-23T18:50:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.527+0000 7f0e2aea8640 1 -- 172.21.15.38:0/4153459117 wait complete. 2023-06-23T18:50:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 Processor -- start 2023-06-23T18:50:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- start start 2023-06-23T18:50:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e240a30c0 0x7f0e241e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e240bea40 0x7f0e241e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 0x7f0e240b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e240baba0 con 0x7f0e240bee10 2023-06-23T18:50:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e240a8950 con 0x7f0e240a30c0 2023-06-23T18:50:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e241e97c0 con 0x7f0e240bea40 2023-06-23T18:50:40.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 0x7f0e240b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 0x7f0e240b9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37396/0 (socket says 172.21.15.38:37396) 2023-06-23T18:50:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 -- 172.21.15.38:0/2271752612 learned_addr learned my addr 172.21.15.38:0/2271752612 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e28c44640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e240a30c0 0x7f0e241e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e23fff640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e240bea40 0x7f0e241e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 -- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e240bea40 msgr2=0x7f0e241e9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e240bea40 0x7f0e241e9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 -- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e240a30c0 msgr2=0x7f0e241e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e240a30c0 0x7f0e241e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180094d0 con 0x7f0e240bee10 2023-06-23T18:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e23fff640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0e240bea40 0x7f0e241e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e29445640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 0x7f0e240b9720 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c780 tx=0x7f0e1c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004b70 con 0x7f0e240bee10 2023-06-23T18:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c00ce90 con 0x7f0e240bee10 2023-06-23T18:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e240b6f30 con 0x7f0e240bee10 2023-06-23T18:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00a850 con 0x7f0e240bee10 2023-06-23T18:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e240b6c30 con 0x7f0e240bee10 2023-06-23T18:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e240c3990 con 0x7f0e240bee10 2023-06-23T18:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e1c00a9b0 con 0x7f0e240bee10 2023-06-23T18:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e10066280 0x7f0e10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e1c084200 con 0x7f0e240bee10 2023-06-23T18:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f0e1006fed0 0x7f0e10072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e100729d0 con 0x7f0e1006fed0 2023-06-23T18:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.531+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e1c0868c0 con 0x7f0e240bee10 2023-06-23T18:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.535+0000 7f0e28c44640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e10066280 0x7f0e10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.535+0000 7f0e23fff640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f0e1006fed0 0x7f0e10072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.535+0000 7f0e23fff640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f0e1006fed0 0x7f0e10072300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.535+0000 7f0e28c44640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e10066280 0x7f0e10068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0e14006fd0 tx=0x7f0e14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.535+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== osd.0 v2:172.21.15.38:6818/575541123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e100729d0 con 0x7f0e1006fed0 2023-06-23T18:50:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 --> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e240a8a90 con 0x7f0e1006fed0 2023-06-23T18:50:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e217fa640 1 -- 172.21.15.38:0/2271752612 <== osd.0 v2:172.21.15.38:6818/575541123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0e180ab730 con 0x7f0e1006fed0 2023-06-23T18:50:40.557 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:40.558 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:40.558 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:40.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f0e1006fed0 msgr2=0x7f0e10072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:6818/575541123,v1:172.21.15.38:6820/575541123] conn(0x7f0e1006fed0 0x7f0e10072300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e10066280 msgr2=0x7f0e10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f0e10066280 0x7f0e10068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0e14006fd0 tx=0x7f0e14008040 comp rx=0 tx=0).stop 2023-06-23T18:50:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 msgr2=0x7f0e240b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 --2- 172.21.15.38:0/2271752612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e240bee10 0x7f0e240b9720 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c780 tx=0x7f0e1c00cc40 comp rx=0 tx=0).stop 2023-06-23T18:50:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e29445640 1 -- 172.21.15.38:0/2271752612 reap_dead start 2023-06-23T18:50:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 shutdown_connections 2023-06-23T18:50:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 >> 172.21.15.38:0/2271752612 conn(0x7f0e240a5cc0 msgr2=0x7f0e240a5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 shutdown_connections 2023-06-23T18:50:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.547+0000 7f0e2aea8640 1 -- 172.21.15.38:0/2271752612 wait complete. 2023-06-23T18:50:40.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-06-23T18:50:40.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 Processor -- start 2023-06-23T18:50:40.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 -- start start 2023-06-23T18:50:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 0x7fb83806c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb83806c9b0 0x7fb838070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8380ba9d0 con 0x7fb8380bd1e0 2023-06-23T18:50:40.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8380bc300 con 0x7fb83806c9b0 2023-06-23T18:50:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83fad8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380a5570 con 0x7fb83814b930 2023-06-23T18:50:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83d073640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8380bd1e0 0x7fb838070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46106/0 (socket says 172.21.15.38:46106) 2023-06-23T18:50:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83d073640 1 -- 172.21.15.38:0/1939306875 learned_addr learned my addr 172.21.15.38:0/1939306875 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929232823 0 0) 0x7fb8380ba9d0 con 0x7fb8380bd1e0 2023-06-23T18:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83d874640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 0x7fb83806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb824003530 con 0x7fb8380bd1e0 2023-06-23T18:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 --2- 172.21.15.38:0/1939306875 >> v2:172.21.15.81:3300/0 conn(0x7fb83806c9b0 0x7fb838070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829130742 0 0) 0x7fb824003530 con 0x7fb8380bd1e0 2023-06-23T18:50:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 msgr2=0x7fb83806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 0x7fb83806c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 >> v2:172.21.15.81:3300/0 conn(0x7fb83806c9b0 msgr2=0x7fb838070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 --2- 172.21.15.38:0/1939306875 >> v2:172.21.15.81:3300/0 conn(0x7fb83806c9b0 0x7fb838070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838150160 con 0x7fb8380bd1e0 2023-06-23T18:50:40.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fb834001680 con 0x7fb8380bd1e0 2023-06-23T18:50:40.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 >> v1:172.21.15.38:6789/0 conn(0x7fb8380bd1e0 legacy=0x7fb838070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb824003980 0x7fb824003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 0x7fb8240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb824004d10 0x7fb824005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380bc300 con 0x7fb824004d10 2023-06-23T18:50:40.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380a5570 con 0x7fb824003980 2023-06-23T18:50:40.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82400b990 con 0x7fb83814b930 2023-06-23T18:50:40.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb824004d10 0x7fb824005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83d874640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb824003980 0x7fb824003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 -- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 msgr2=0x7fb8240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb83814b930 0x7fb8240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 -- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb824003980 msgr2=0x7fb824003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:40.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb824003980 0x7fb824003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.683+0000 7fb83e075640 1 -- 172.21.15.38:0/1939306875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824003530 con 0x7fb824004d10 2023-06-23T18:50:40.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83e075640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb824004d10 0x7fb824005180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb830009fc0 tx=0x7fb83001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ced18d2f03de7c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300a5cb0 con 0x7fb824004d10 2023-06-23T18:50:40.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000f040 con 0x7fb824004d10 2023-06-23T18:50:40.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83c872640 1 -- 172.21.15.38:0/1939306875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300ad680 con 0x7fb824004d10 2023-06-23T18:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 -- 172.21.15.38:0/1939306875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb824004d10 msgr2=0x7fb824005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1939306875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb824004d10 0x7fb824005180 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb830009fc0 tx=0x7fb83001cc40 comp rx=0 tx=0).stop 2023-06-23T18:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83e075640 1 -- 172.21.15.38:0/1939306875 reap_dead start 2023-06-23T18:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 -- 172.21.15.38:0/1939306875 shutdown_connections 2023-06-23T18:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 -- 172.21.15.38:0/1939306875 >> 172.21.15.38:0/1939306875 conn(0x7fb8380c0c90 msgr2=0x7fb8380bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 -- 172.21.15.38:0/1939306875 shutdown_connections 2023-06-23T18:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.687+0000 7fb83fad8640 1 -- 172.21.15.38:0/1939306875 wait complete. 2023-06-23T18:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 Processor -- start 2023-06-23T18:50:40.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- start start 2023-06-23T18:50:40.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb824004d10 0x7fb8380b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 0x7fb83814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380b7c00 con 0x7fb8380b8f40 2023-06-23T18:50:40.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380b9550 con 0x7fb8380b8020 2023-06-23T18:50:40.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380b7610 con 0x7fb824004d10 2023-06-23T18:50:40.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37410/0 (socket says 172.21.15.38:37410) 2023-06-23T18:50:40.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 -- 172.21.15.38:0/1306115414 learned_addr learned my addr 172.21.15.38:0/1306115414 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:40.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83d874640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb824004d10 0x7fb8380b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83d073640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 0x7fb83814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 -- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb824004d10 msgr2=0x7fb8380b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb824004d10 0x7fb8380b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 -- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 msgr2=0x7fb83814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 0x7fb83814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 -- 172.21.15.38:0/1306115414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83814f270 con 0x7fb8380b8f40 2023-06-23T18:50:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83d073640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 0x7fb83814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:40.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83e075640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8300b0040 tx=0x7fb830009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300039a0 con 0x7fb8380b8f40 2023-06-23T18:50:40.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830003b20 con 0x7fb8380b8f40 2023-06-23T18:50:40.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380b7820 con 0x7fb8380b8f40 2023-06-23T18:50:40.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300ae890 con 0x7fb8380b8f40 2023-06-23T18:50:40.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb838146a40 con 0x7fb8380b8f40 2023-06-23T18:50:40.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.691+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83804d790 con 0x7fb8380b8f40 2023-06-23T18:50:40.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.695+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8300b4040 con 0x7fb8380b8f40 2023-06-23T18:50:40.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.695+0000 7fb82e7fc640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:40.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.695+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb83011de00 con 0x7fb8380b8f40 2023-06-23T18:50:40.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.695+0000 7fb83d874640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:40.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.695+0000 7fb83d874640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 0x7fb81c068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb828009b40 tx=0x7fb828008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:40.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.699+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8300eb020 con 0x7fb8380b8f40 2023-06-23T18:50:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.855+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb838150440 con 0x7fb81c066280 2023-06-23T18:50:40.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.855+0000 7fb82e7fc640 1 -- 172.21.15.38:0/1306115414 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb828014af0 con 0x7fb81c066280 2023-06-23T18:50:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2023-06-23T18:50:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 msgr2=0x7fb81c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 0x7fb81c068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb828009b40 tx=0x7fb828008040 comp rx=0 tx=0).stop 2023-06-23T18:50:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 msgr2=0x7fb838146330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8300b0040 tx=0x7fb830009750 comp rx=0 tx=0).stop 2023-06-23T18:50:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 shutdown_connections 2023-06-23T18:50:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8380b8f40 0x7fb838146330 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8380b8020 0x7fb83814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 --2- 172.21.15.38:0/1306115414 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb824004d10 0x7fb8380b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 >> 172.21.15.38:0/1306115414 conn(0x7fb8380c0c90 msgr2=0x7fb8380bf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 shutdown_connections 2023-06-23T18:50:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.859+0000 7fb83fad8640 1 -- 172.21.15.38:0/1306115414 wait complete. 2023-06-23T18:50:40.886 INFO:tasks.ceph:Scrubbing osd.1 2023-06-23T18:50:40.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 Processor -- start 2023-06-23T18:50:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 -- start start 2023-06-23T18:50:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f891406c6d0 0x7f8914070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140b9ca0 con 0x7f89140bc4f0 2023-06-23T18:50:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140714a0 con 0x7f89140bd9b0 2023-06-23T18:50:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f891c06d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140a55b0 con 0x7f891406c6d0 2023-06-23T18:50:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f891406c6d0 0x7f8914070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f891406c6d0 0x7f8914070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37422/0 (socket says 172.21.15.38:37422) 2023-06-23T18:50:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 -- 172.21.15.38:0/1756063577 learned_addr learned my addr 172.21.15.38:0/1756063577 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 -- 172.21.15.38:0/1756063577 >> v1:172.21.15.81:6789/0 conn(0x7f89140bd9b0 legacy=0x7f89140a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 -- 172.21.15.38:0/1756063577 >> v1:172.21.15.38:6789/0 conn(0x7f89140bc4f0 legacy=0x7f891414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8919e09640 1 -- 172.21.15.38:0/1756063577 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891406a3f0 con 0x7f891406c6d0 2023-06-23T18:50:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:40.999+0000 7f8918e07640 1 -- 172.21.15.38:0/1756063577 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745411653 0 0) 0x7f89140b9ca0 con 0x7f89140bc4f0 2023-06-23T18:50:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f8919e09640 1 --2- 172.21.15.38:0/1756063577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914070f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8910009e50 tx=0x7f891001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb6677b37ed92e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f8918e07640 1 -- 172.21.15.38:0/1756063577 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a5750 con 0x7f891406c6d0 2023-06-23T18:50:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f8918e07640 1 -- 172.21.15.38:0/1756063577 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100a58b0 con 0x7f891406c6d0 2023-06-23T18:50:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f8918e07640 1 -- 172.21.15.38:0/1756063577 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100a5c40 con 0x7f891406c6d0 2023-06-23T18:50:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- 172.21.15.38:0/1756063577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 msgr2=0x7f8914070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 --2- 172.21.15.38:0/1756063577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914070f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8910009e50 tx=0x7f891001c980 comp rx=0 tx=0).stop 2023-06-23T18:50:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- 172.21.15.38:0/1756063577 shutdown_connections 2023-06-23T18:50:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 --2- 172.21.15.38:0/1756063577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914070f60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- 172.21.15.38:0/1756063577 >> 172.21.15.38:0/1756063577 conn(0x7f89140c0c90 msgr2=0x7f89140bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- 172.21.15.38:0/1756063577 shutdown_connections 2023-06-23T18:50:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- 172.21.15.38:0/1756063577 wait complete. 2023-06-23T18:50:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 Processor -- start 2023-06-23T18:50:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.003+0000 7f891c06d640 1 -- start start 2023-06-23T18:50:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89140bc4f0 0x7f891414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89140bd9b0 0x7f891414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891414e250 con 0x7f891406c6d0 2023-06-23T18:50:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89141566b0 con 0x7f89140bc4f0 2023-06-23T18:50:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8914146ab0 con 0x7f89140bd9b0 2023-06-23T18:50:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37436/0 (socket says 172.21.15.38:37436) 2023-06-23T18:50:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 -- 172.21.15.38:0/3536719914 learned_addr learned my addr 172.21.15.38:0/3536719914 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919608640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89140bc4f0 0x7f891414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891a60a640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89140bd9b0 0x7f891414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 -- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89140bd9b0 msgr2=0x7f891414ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89140bd9b0 0x7f891414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 -- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89140bc4f0 msgr2=0x7f891414c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89140bc4f0 0x7f891414c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009b30 con 0x7f891406c6d0 2023-06-23T18:50:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919608640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89140bc4f0 0x7f891414c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919e09640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914146570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f89100af040 tx=0x7f8910019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100b8670 con 0x7f891406c6d0 2023-06-23T18:50:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100b87f0 con 0x7f891406c6d0 2023-06-23T18:50:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8914150df0 con 0x7f891406c6d0 2023-06-23T18:50:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89100b8ba0 con 0x7f891406c6d0 2023-06-23T18:50:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891414de70 con 0x7f891406c6d0 2023-06-23T18:50:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f891406caa0 con 0x7f891406c6d0 2023-06-23T18:50:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89100b8d00 con 0x7f891406c6d0 2023-06-23T18:50:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88f8066280 0x7f88f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f891011fb90 con 0x7f891406c6d0 2023-06-23T18:50:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f88f806fed0 0x7f88f8072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88f80729d0 con 0x7f88f806fed0 2023-06-23T18:50:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f891011ff00 con 0x7f891406c6d0 2023-06-23T18:50:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f891a60a640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f88f806fed0 0x7f88f8072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.007+0000 7f8919608640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88f8066280 0x7f88f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.011+0000 7f891a60a640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f88f806fed0 0x7f88f8072300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.011+0000 7f8919608640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88f8066280 0x7f88f8068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8914141120 tx=0x7f8904009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.011+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== osd.1 v2:172.21.15.38:6800/978431787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f88f80729d0 con 0x7f88f806fed0 2023-06-23T18:50:41.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 --> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f891414e4c0 con 0x7f88f806fed0 2023-06-23T18:50:41.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f890a7fc640 1 -- 172.21.15.38:0/3536719914 <== osd.1 v2:172.21.15.38:6800/978431787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f891414e4c0 con 0x7f88f806fed0 2023-06-23T18:50:41.033 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:41.033 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:41.033 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f88f806fed0 msgr2=0x7f88f8072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:6800/978431787,v1:172.21.15.38:6801/978431787] conn(0x7f88f806fed0 0x7f88f8072300 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88f8066280 msgr2=0x7f88f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88f8066280 0x7f88f8068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8914141120 tx=0x7f8904009040 comp rx=0 tx=0).stop 2023-06-23T18:50:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 msgr2=0x7f8914146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 --2- 172.21.15.38:0/3536719914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891406c6d0 0x7f8914146570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f89100af040 tx=0x7f8910019720 comp rx=0 tx=0).stop 2023-06-23T18:50:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891a60a640 1 -- 172.21.15.38:0/3536719914 reap_dead start 2023-06-23T18:50:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 shutdown_connections 2023-06-23T18:50:41.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 >> 172.21.15.38:0/3536719914 conn(0x7f89140c0c90 msgr2=0x7f89140bbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 shutdown_connections 2023-06-23T18:50:41.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.023+0000 7f891c06d640 1 -- 172.21.15.38:0/3536719914 wait complete. 2023-06-23T18:50:41.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-06-23T18:50:41.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 Processor -- start 2023-06-23T18:50:41.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 -- start start 2023-06-23T18:50:41.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e800bd1e0 0x7f4e8014c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e800ba9d0 con 0x7f4e8014b930 2023-06-23T18:50:41.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80150160 con 0x7f4e8006a630 2023-06-23T18:50:41.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e84d86640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800bc300 con 0x7f4e800bd1e0 2023-06-23T18:50:41.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4e8014b930 0x7f4e8006c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46118/0 (socket says 172.21.15.38:46118) 2023-06-23T18:50:41.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7e59c640 1 -- 172.21.15.38:0/3424248699 learned_addr learned my addr 172.21.15.38:0/3424248699 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:41.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/3424248699 >> v2:172.21.15.81:3300/0 conn(0x7f4e800bd1e0 0x7f4e8014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047133530 0 0) 0x7f4e800ba9d0 con 0x7f4e8014b930 2023-06-23T18:50:41.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c003530 con 0x7f4e8014b930 2023-06-23T18:50:41.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 912825685 0 0) 0x7f4e6c003530 con 0x7f4e8014b930 2023-06-23T18:50:41.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 >> v2:172.21.15.81:3300/0 conn(0x7f4e800bd1e0 msgr2=0x7f4e8014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 --2- 172.21.15.38:0/3424248699 >> v2:172.21.15.81:3300/0 conn(0x7f4e800bd1e0 0x7f4e8014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 >> v1:172.21.15.81:6789/0 conn(0x7f4e8006a630 legacy=0x7f4e8014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80150440 con 0x7f4e8014b930 2023-06-23T18:50:41.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f4e70001a00 con 0x7f4e8014b930 2023-06-23T18:50:41.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 >> v1:172.21.15.38:6789/0 conn(0x7f4e8014b930 legacy=0x7f4e8006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c003980 0x7f4e6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c005180 0x7f4e6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800bc300 con 0x7f4e6c0047d0 2023-06-23T18:50:41.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.159+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c00c000 con 0x7f4e6c003980 2023-06-23T18:50:41.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c00c1c0 con 0x7f4e6c005180 2023-06-23T18:50:41.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7e59c640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c003980 0x7f4e6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 -- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c005180 msgr2=0x7f4e6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c005180 0x7f4e6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 -- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c003980 msgr2=0x7f4e6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c003980 0x7f4e6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 -- 172.21.15.38:0/3424248699 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c003530 con 0x7f4e6c0047d0 2023-06-23T18:50:41.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7ed9d640 1 -- 172.21.15.38:0/3424248699 reap_dead start 2023-06-23T18:50:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e6c004c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009ae0 tx=0x7f4e6801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c9b0bb6fbf16b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680a6480 con 0x7f4e6c0047d0 2023-06-23T18:50:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e680a65e0 con 0x7f4e6c0047d0 2023-06-23T18:50:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e7d59a640 1 -- 172.21.15.38:0/3424248699 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680a6990 con 0x7f4e6c0047d0 2023-06-23T18:50:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 -- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 msgr2=0x7f4e6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e6c004c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009ae0 tx=0x7f4e6801ca70 comp rx=0 tx=0).stop 2023-06-23T18:50:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 -- 172.21.15.38:0/3424248699 shutdown_connections 2023-06-23T18:50:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 --2- 172.21.15.38:0/3424248699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e6c004c40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 -- 172.21.15.38:0/3424248699 >> 172.21.15.38:0/3424248699 conn(0x7f4e800c0c90 msgr2=0x7f4e800bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 -- 172.21.15.38:0/3424248699 shutdown_connections 2023-06-23T18:50:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.163+0000 7f4e84d86640 1 -- 172.21.15.38:0/3424248699 wait complete. 2023-06-23T18:50:41.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 Processor -- start 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- start start 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e800b74d0 0x7f4e800a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e800b98f0 0x7f4e801e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800a5570 con 0x7f4e6c0047d0 2023-06-23T18:50:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80098ce0 con 0x7f4e800b98f0 2023-06-23T18:50:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b82a0 con 0x7f4e800b74d0 2023-06-23T18:50:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37452/0 (socket says 172.21.15.38:37452) 2023-06-23T18:50:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 -- 172.21.15.38:0/990842651 learned_addr learned my addr 172.21.15.38:0/990842651 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e800b74d0 0x7f4e800a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 -- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e800b74d0 msgr2=0x7f4e800a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e800b74d0 0x7f4e800a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7ed9d640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e800b98f0 0x7f4e801e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 -- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e800b98f0 msgr2=0x7f4e801e0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e800b98f0 0x7f4e801e0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 -- 172.21.15.38:0/990842651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800a4a60 con 0x7f4e6c0047d0 2023-06-23T18:50:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e7e59c640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4e70002240 tx=0x7f4e70011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000fb60 con 0x7f4e6c0047d0 2023-06-23T18:50:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7000fce0 con 0x7f4e6c0047d0 2023-06-23T18:50:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e800b8520 con 0x7f4e6c0047d0 2023-06-23T18:50:41.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70015650 con 0x7f4e6c0047d0 2023-06-23T18:50:41.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800b8ae0 con 0x7f4e6c0047d0 2023-06-23T18:50:41.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8004d790 con 0x7f4e6c0047d0 2023-06-23T18:50:41.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e700157b0 con 0x7f4e6c0047d0 2023-06-23T18:50:41.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.167+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e700872f0 con 0x7f4e6c0047d0 2023-06-23T18:50:41.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.171+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.171+0000 7f4e7dd9b640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 0x7f4e60068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e680ad000 tx=0x7f4e680a9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.175+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e70054510 con 0x7f4e6c0047d0 2023-06-23T18:50:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.327+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e8014bd00 con 0x7f4e60066280 2023-06-23T18:50:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.327+0000 7f4e76ffd640 1 -- 172.21.15.38:0/990842651 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e680a67d0 con 0x7f4e60066280 2023-06-23T18:50:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2023-06-23T18:50:41.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 msgr2=0x7f4e60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 0x7f4e60068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e680ad000 tx=0x7f4e680a9040 comp rx=0 tx=0).stop 2023-06-23T18:50:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 msgr2=0x7f4e800b9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4e70002240 tx=0x7f4e70011ca0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 shutdown_connections 2023-06-23T18:50:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f4e60066280 0x7f4e60068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e800b98f0 0x7f4e801e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e800b74d0 0x7f4e800a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 --2- 172.21.15.38:0/990842651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e6c0047d0 0x7f4e800b9000 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 >> 172.21.15.38:0/990842651 conn(0x7f4e800c0c90 msgr2=0x7f4e80072850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 shutdown_connections 2023-06-23T18:50:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.331+0000 7f4e84d86640 1 -- 172.21.15.38:0/990842651 wait complete. 2023-06-23T18:50:41.356 INFO:tasks.ceph:Scrubbing osd.2 2023-06-23T18:50:41.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:41.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 Processor -- start 2023-06-23T18:50:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 -- start start 2023-06-23T18:50:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6dcc06c6d0 0x7f6dcc0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0bd410 con 0x7f6dcc071290 2023-06-23T18:50:41.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0a53a0 con 0x7f6dcc06a630 2023-06-23T18:50:41.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd44c3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc151a00 con 0x7f6dcc06c6d0 2023-06-23T18:50:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6dcc071290 0x7f6dcc0b9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46128/0 (socket says 172.21.15.38:46128) 2023-06-23T18:50:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 -- 172.21.15.38:0/2833331049 learned_addr learned my addr 172.21.15.38:0/2833331049 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd225f640 1 --2- 172.21.15.38:0/2833331049 >> v2:172.21.15.81:3300/0 conn(0x7f6dcc06c6d0 0x7f6dcc0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175405997 0 0) 0x7f6dcc0bd410 con 0x7f6dcc071290 2023-06-23T18:50:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db8003530 con 0x7f6dcc071290 2023-06-23T18:50:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87916870 0 0) 0x7f6dcc0a53a0 con 0x7f6dcc06a630 2023-06-23T18:50:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc0bd410 con 0x7f6dcc06a630 2023-06-23T18:50:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188776342 0 0) 0x7f6db8003530 con 0x7f6dcc071290 2023-06-23T18:50:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 >> v2:172.21.15.81:3300/0 conn(0x7f6dcc06c6d0 msgr2=0x7f6dcc0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 --2- 172.21.15.38:0/2833331049 >> v2:172.21.15.81:3300/0 conn(0x7f6dcc06c6d0 0x7f6dcc0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 >> v1:172.21.15.81:6789/0 conn(0x7f6dcc06a630 legacy=0x7f6dcc14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc06a310 con 0x7f6dcc071290 2023-06-23T18:50:41.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f6dbc001680 con 0x7f6dcc071290 2023-06-23T18:50:41.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 >> v1:172.21.15.38:6789/0 conn(0x7f6dcc071290 legacy=0x7f6dcc0b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6db8003b10 0x7f6db8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 0x7f6db8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db8005180 0x7f6db800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc151a00 con 0x7f6db80047d0 2023-06-23T18:50:41.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800bfe0 con 0x7f6db8005180 2023-06-23T18:50:41.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800c1a0 con 0x7f6db8003b10 2023-06-23T18:50:41.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 0x7f6db8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd2a60640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db8005180 0x7f6db800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd225f640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6db8003b10 0x7f6db8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 -- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6db8003b10 msgr2=0x7f6db8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6db8003b10 0x7f6db8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 -- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db8005180 msgr2=0x7f6db800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db8005180 0x7f6db800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd2a60640 1 -- 172.21.15.38:0/2833331049 reap_dead start 2023-06-23T18:50:41.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.471+0000 7f6dd1a5e640 1 -- 172.21.15.38:0/2833331049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8003530 con 0x7f6db80047d0 2023-06-23T18:50:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 0x7f6db8004c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c160 tx=0x7f6dbc01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b1502b9748bc22 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0058e0 con 0x7f6db80047d0 2023-06-23T18:50:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc005a60 con 0x7f6db80047d0 2023-06-23T18:50:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd125d640 1 -- 172.21.15.38:0/2833331049 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005e50 con 0x7f6db80047d0 2023-06-23T18:50:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 msgr2=0x7f6db8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 0x7f6db8004c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c160 tx=0x7f6dbc01cba0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- 172.21.15.38:0/2833331049 shutdown_connections 2023-06-23T18:50:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 --2- 172.21.15.38:0/2833331049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6db80047d0 0x7f6db8004c40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- 172.21.15.38:0/2833331049 >> 172.21.15.38:0/2833331049 conn(0x7f6dcc0c0c90 msgr2=0x7f6dcc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- 172.21.15.38:0/2833331049 shutdown_connections 2023-06-23T18:50:41.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- 172.21.15.38:0/2833331049 wait complete. 2023-06-23T18:50:41.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 Processor -- start 2023-06-23T18:50:41.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.475+0000 7f6dd44c3640 1 -- start start 2023-06-23T18:50:41.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db80047d0 0x7f6dcc149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6dcc1e27b0 0x7f6dcc1e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 0x7f6dcc1e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc14ea50 con 0x7f6dcc1e6850 2023-06-23T18:50:41.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1e3160 con 0x7f6db80047d0 2023-06-23T18:50:41.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc141900 con 0x7f6dcc1e27b0 2023-06-23T18:50:41.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 0x7f6dcc1e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 0x7f6dcc1e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37466/0 (socket says 172.21.15.38:37466) 2023-06-23T18:50:41.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 -- 172.21.15.38:0/1928484366 learned_addr learned my addr 172.21.15.38:0/1928484366 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6dcc1e27b0 0x7f6dcc1e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd225f640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db80047d0 0x7f6dcc149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 -- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6dcc1e27b0 msgr2=0x7f6dcc1e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6dcc1e27b0 0x7f6dcc1e2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 -- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db80047d0 msgr2=0x7f6dcc149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db80047d0 0x7f6dcc149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc14a320 con 0x7f6dcc1e6850 2023-06-23T18:50:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd225f640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db80047d0 0x7f6dcc149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd2a60640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 0x7f6dcc1e6cc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc06dae0 tx=0x7f6dc4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40136e0 con 0x7f6dcc1e6850 2023-06-23T18:50:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4013840 con 0x7f6dcc1e6850 2023-06-23T18:50:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc147de0 con 0x7f6dcc1e6850 2023-06-23T18:50:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013bf0 con 0x7f6dcc1e6850 2023-06-23T18:50:41.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc1e4130 con 0x7f6dcc1e6850 2023-06-23T18:50:41.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dcc0b93e0 con 0x7f6dcc1e6850 2023-06-23T18:50:41.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6dc4013d50 con 0x7f6dcc1e6850 2023-06-23T18:50:41.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6db00662b0 0x7f6db0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6dc4086520 con 0x7f6dcc1e6850 2023-06-23T18:50:41.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f6db006ff00 0x7f6db0072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6db0072a00 con 0x7f6db006ff00 2023-06-23T18:50:41.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dc4088be0 con 0x7f6dcc1e6850 2023-06-23T18:50:41.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f6db006ff00 0x7f6db0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.479+0000 7f6dd225f640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6db00662b0 0x7f6db0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.483+0000 7f6dd1a5e640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f6db006ff00 0x7f6db0072330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.483+0000 7f6dd225f640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6db00662b0 0x7f6db0068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc04f0d0 tx=0x7f6dc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.483+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== osd.2 v2:172.21.15.38:6808/1605176588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6db0072a00 con 0x7f6db006ff00 2023-06-23T18:50:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 --> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6dcc1e4350 con 0x7f6db006ff00 2023-06-23T18:50:41.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dc2ffd640 1 -- 172.21.15.38:0/1928484366 <== osd.2 v2:172.21.15.38:6808/1605176588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6dcc1e4350 con 0x7f6db006ff00 2023-06-23T18:50:41.513 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:41.513 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:41.514 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f6db006ff00 msgr2=0x7f6db0072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:6808/1605176588,v1:172.21.15.38:6809/1605176588] conn(0x7f6db006ff00 0x7f6db0072330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6db00662b0 msgr2=0x7f6db0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f6db00662b0 0x7f6db0068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc04f0d0 tx=0x7f6dc8008040 comp rx=0 tx=0).stop 2023-06-23T18:50:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 msgr2=0x7f6dcc1e6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 --2- 172.21.15.38:0/1928484366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dcc1e6850 0x7f6dcc1e6cc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc06dae0 tx=0x7f6dc4011bc0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd2a60640 1 -- 172.21.15.38:0/1928484366 reap_dead start 2023-06-23T18:50:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 shutdown_connections 2023-06-23T18:50:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 >> 172.21.15.38:0/1928484366 conn(0x7f6dcc0c0c90 msgr2=0x7f6dcc070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 shutdown_connections 2023-06-23T18:50:41.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.495+0000 7f6dd44c3640 1 -- 172.21.15.38:0/1928484366 wait complete. 2023-06-23T18:50:41.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-06-23T18:50:41.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 Processor -- start 2023-06-23T18:50:41.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 -- start start 2023-06-23T18:50:41.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88f00a4e30 0x7f88f006e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88f0071220 0x7f88f014a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f006f2d0 con 0x7f88f0149eb0 2023-06-23T18:50:41.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f006a7a0 con 0x7f88f00a4e30 2023-06-23T18:50:41.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f6cb6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f014a7c0 con 0x7f88f0071220 2023-06-23T18:50:41.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88f00a4e30 0x7f88f006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88f00a4e30 0x7f88f006e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37478/0 (socket says 172.21.15.38:37478) 2023-06-23T18:50:41.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 -- 172.21.15.38:0/4242837394 learned_addr learned my addr 172.21.15.38:0/4242837394 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88f5253640 1 --2- 172.21.15.38:0/4242837394 >> v2:172.21.15.81:3300/0 conn(0x7f88f0071220 0x7f88f014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 -- 172.21.15.38:0/4242837394 >> v2:172.21.15.81:3300/0 conn(0x7f88f0071220 msgr2=0x7f88f014a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 --2- 172.21.15.38:0/4242837394 >> v2:172.21.15.81:3300/0 conn(0x7f88f0071220 0x7f88f014a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 -- 172.21.15.38:0/4242837394 >> v1:172.21.15.81:6789/0 conn(0x7f88f0149eb0 legacy=0x7f88f00bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.627+0000 7f88effff640 1 -- 172.21.15.38:0/4242837394 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f006a4c0 con 0x7f88f00a4e30 2023-06-23T18:50:41.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88effff640 1 --2- 172.21.15.38:0/4242837394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f00a4e30 0x7f88f006e050 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f88f00a5710 tx=0x7f88e001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd8b1fc03b8cdb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88ef7fe640 1 -- 172.21.15.38:0/4242837394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000b2d0 con 0x7f88f00a4e30 2023-06-23T18:50:41.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88ef7fe640 1 -- 172.21.15.38:0/4242837394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000b430 con 0x7f88f00a4e30 2023-06-23T18:50:41.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88ef7fe640 1 -- 172.21.15.38:0/4242837394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00a7af0 con 0x7f88f00a4e30 2023-06-23T18:50:41.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- 172.21.15.38:0/4242837394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f00a4e30 msgr2=0x7f88f006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/4242837394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f00a4e30 0x7f88f006e050 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f88f00a5710 tx=0x7f88e001ebd0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- 172.21.15.38:0/4242837394 shutdown_connections 2023-06-23T18:50:41.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/4242837394 >> v2:172.21.15.81:3300/0 conn(0x7f88f0071220 0x7f88f014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/4242837394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f00a4e30 0x7f88f006e050 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- 172.21.15.38:0/4242837394 >> 172.21.15.38:0/4242837394 conn(0x7f88f00c0c90 msgr2=0x7f88f00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- 172.21.15.38:0/4242837394 shutdown_connections 2023-06-23T18:50:41.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- 172.21.15.38:0/4242837394 wait complete. 2023-06-23T18:50:41.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 Processor -- start 2023-06-23T18:50:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.631+0000 7f88f6cb6640 1 -- start start 2023-06-23T18:50:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88f00a4e30 0x7f88f013d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88f0149eb0 0x7f88f013d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01495a0 con 0x7f88f0071220 2023-06-23T18:50:41.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f013db20 con 0x7f88f0149eb0 2023-06-23T18:50:41.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0148590 con 0x7f88f00a4e30 2023-06-23T18:50:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37482/0 (socket says 172.21.15.38:37482) 2023-06-23T18:50:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 -- 172.21.15.38:0/2345232212 learned_addr learned my addr 172.21.15.38:0/2345232212 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88effff640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88f00a4e30 0x7f88f013d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f5253640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88f0149eb0 0x7f88f013d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 -- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88f00a4e30 msgr2=0x7f88f013d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88f00a4e30 0x7f88f013d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 -- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88f0149eb0 msgr2=0x7f88f013d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88f0149eb0 0x7f88f013d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 -- 172.21.15.38:0/2345232212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e000bd40 con 0x7f88f0071220 2023-06-23T18:50:41.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f4a52640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c3f0 tx=0x7f88e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40052d0 con 0x7f88f0071220 2023-06-23T18:50:41.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4005430 con 0x7f88f0071220 2023-06-23T18:50:41.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f0148870 con 0x7f88f0071220 2023-06-23T18:50:41.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4003840 con 0x7f88f0071220 2023-06-23T18:50:41.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f01409d0 con 0x7f88f0071220 2023-06-23T18:50:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f004d790 con 0x7f88f0071220 2023-06-23T18:50:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88e40039a0 con 0x7f88f0071220 2023-06-23T18:50:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88e40835e0 con 0x7f88f0071220 2023-06-23T18:50:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.635+0000 7f88effff640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.639+0000 7f88effff640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 0x7f88dc068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88e00b0000 tx=0x7f88e00a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.639+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88e4050760 con 0x7f88f0071220 2023-06-23T18:50:41.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f014aec0 con 0x7f88dc066280 2023-06-23T18:50:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88ed7fa640 1 -- 172.21.15.38:0/2345232212 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88e00be090 con 0x7f88dc066280 2023-06-23T18:50:41.804 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2023-06-23T18:50:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 msgr2=0x7f88dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 0x7f88dc068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f88e00b0000 tx=0x7f88e00a9070 comp rx=0 tx=0).stop 2023-06-23T18:50:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 msgr2=0x7f88f01401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c3f0 tx=0x7f88e400c8b0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 shutdown_connections 2023-06-23T18:50:41.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88f0149eb0 0x7f88f013d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88f00a4e30 0x7f88f013d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 --2- 172.21.15.38:0/2345232212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f0071220 0x7f88f01401d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 >> 172.21.15.38:0/2345232212 conn(0x7f88f00c0c90 msgr2=0x7f88f0144a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 shutdown_connections 2023-06-23T18:50:41.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.795+0000 7f88f6cb6640 1 -- 172.21.15.38:0/2345232212 wait complete. 2023-06-23T18:50:41.822 INFO:tasks.ceph:Scrubbing osd.3 2023-06-23T18:50:41.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 Processor -- start 2023-06-23T18:50:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 -- start start 2023-06-23T18:50:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ed406a630 0x7f9ed414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40ba9d0 con 0x7f9ed40bd1e0 2023-06-23T18:50:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed4150160 con 0x7f9ed414b930 2023-06-23T18:50:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9eda92e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40bc300 con 0x7f9ed406a630 2023-06-23T18:50:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed37fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9ed40bd1e0 0x7f9ed414c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46142/0 (socket says 172.21.15.38:46142) 2023-06-23T18:50:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed37fe640 1 -- 172.21.15.38:0/1115656038 learned_addr learned my addr 172.21.15.38:0/1115656038 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1115656038 >> v2:172.21.15.38:3300/0 conn(0x7f9ed406a630 0x7f9ed414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed2ffd640 1 -- 172.21.15.38:0/1115656038 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190963493 0 0) 0x7f9ed40ba9d0 con 0x7f9ed40bd1e0 2023-06-23T18:50:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed2ffd640 1 -- 172.21.15.38:0/1115656038 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec0003530 con 0x7f9ed40bd1e0 2023-06-23T18:50:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed8ecb640 1 -- 172.21.15.38:0/1115656038 >> v1:172.21.15.81:6789/0 conn(0x7f9ed414b930 legacy=0x7f9ed406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:41.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed8ecb640 1 -- 172.21.15.38:0/1115656038 >> v1:172.21.15.38:6789/0 conn(0x7f9ed40bd1e0 legacy=0x7f9ed414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.931+0000 7f9ed8ecb640 1 -- 172.21.15.38:0/1115656038 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4150440 con 0x7f9ed406a630 2023-06-23T18:50:41.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.935+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1115656038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414caa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88562df582a61b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.935+0000 7f9ed2ffd640 1 -- 172.21.15.38:0/1115656038 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40ab600 con 0x7f9ed406a630 2023-06-23T18:50:41.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.935+0000 7f9ed2ffd640 1 -- 172.21.15.38:0/1115656038 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40a7050 con 0x7f9ed406a630 2023-06-23T18:50:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.935+0000 7f9ed2ffd640 1 -- 172.21.15.38:0/1115656038 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40ab960 con 0x7f9ed406a630 2023-06-23T18:50:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1115656038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 msgr2=0x7f9ed414caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 --2- 172.21.15.38:0/1115656038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414caa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c440 comp rx=0 tx=0).stop 2023-06-23T18:50:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1115656038 shutdown_connections 2023-06-23T18:50:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 --2- 172.21.15.38:0/1115656038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414caa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1115656038 >> 172.21.15.38:0/1115656038 conn(0x7f9ed40c0c90 msgr2=0x7f9ed40bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1115656038 shutdown_connections 2023-06-23T18:50:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1115656038 wait complete. 2023-06-23T18:50:41.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 Processor -- start 2023-06-23T18:50:41.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- start start 2023-06-23T18:50:41.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ed40bd1e0 0x7f9ed40704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed414b930 0x7f9ed40b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40a5570 con 0x7f9ed406a630 2023-06-23T18:50:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed414f580 con 0x7f9ed414b930 2023-06-23T18:50:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4070a00 con 0x7f9ed40bd1e0 2023-06-23T18:50:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37486/0 (socket says 172.21.15.38:37486) 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 -- 172.21.15.38:0/1016510802 learned_addr learned my addr 172.21.15.38:0/1016510802 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed37fe640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ed40bd1e0 0x7f9ed40704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed414b930 0x7f9ed40b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 -- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ed40bd1e0 msgr2=0x7f9ed40704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ed40bd1e0 0x7f9ed40704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 -- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed414b930 msgr2=0x7f9ed40b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed414b930 0x7f9ed40b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009420 con 0x7f9ed406a630 2023-06-23T18:50:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ed414b930 0x7f9ed40b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed37fe640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9ed40bd1e0 0x7f9ed40704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed3fff640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414f040 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00ba80 tx=0x7f9ecc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00cc00 con 0x7f9ed406a630 2023-06-23T18:50:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00cd60 con 0x7f9ed406a630 2023-06-23T18:50:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc003bc0 con 0x7f9ed406a630 2023-06-23T18:50:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed413f560 con 0x7f9ed406a630 2023-06-23T18:50:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed414e240 con 0x7f9ed406a630 2023-06-23T18:50:41.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.939+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ed414cfe0 con 0x7f9ed406a630 2023-06-23T18:50:41.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ecc014440 con 0x7f9ed406a630 2023-06-23T18:50:41.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9eb4066280 0x7f9eb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ecc083e10 con 0x7f9ed406a630 2023-06-23T18:50:41.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f9eb406fed0 0x7f9eb4072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:41.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9eb40729d0 con 0x7f9eb406fed0 2023-06-23T18:50:41.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ecc0864d0 con 0x7f9ed406a630 2023-06-23T18:50:41.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f9eb406fed0 0x7f9eb4072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed37fe640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9eb4066280 0x7f9eb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:41.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed8ecb640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f9eb406fed0 0x7f9eb4072300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed37fe640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9eb4066280 0x7f9eb4068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406a550 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:41.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.943+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== osd.3 v2:172.21.15.38:6816/1363740470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9eb40729d0 con 0x7f9eb406fed0 2023-06-23T18:50:41.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 --> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ed414e3d0 con 0x7f9eb406fed0 2023-06-23T18:50:41.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9ed0ff9640 1 -- 172.21.15.38:0/1016510802 <== osd.3 v2:172.21.15.38:6816/1363740470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9ed414e3d0 con 0x7f9eb406fed0 2023-06-23T18:50:41.965 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:41.966 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:41.966 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f9eb406fed0 msgr2=0x7f9eb4072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:6816/1363740470,v1:172.21.15.38:6817/1363740470] conn(0x7f9eb406fed0 0x7f9eb4072300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:41.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9eb4066280 msgr2=0x7f9eb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f9eb4066280 0x7f9eb4068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406a550 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2023-06-23T18:50:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 msgr2=0x7f9ed414f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 --2- 172.21.15.38:0/1016510802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ed406a630 0x7f9ed414f040 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00ba80 tx=0x7f9ecc00bf40 comp rx=0 tx=0).stop 2023-06-23T18:50:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9ed8ecb640 1 -- 172.21.15.38:0/1016510802 reap_dead start 2023-06-23T18:50:41.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 shutdown_connections 2023-06-23T18:50:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 >> 172.21.15.38:0/1016510802 conn(0x7f9ed40c0c90 msgr2=0x7f9ed406c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 shutdown_connections 2023-06-23T18:50:41.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:41.955+0000 7f9eda92e640 1 -- 172.21.15.38:0/1016510802 wait complete. 2023-06-23T18:50:41.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-06-23T18:50:42.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.083+0000 7fd836533640 1 Processor -- start 2023-06-23T18:50:42.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.083+0000 7fd836533640 1 -- start start 2023-06-23T18:50:42.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd836533640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd836533640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8300a61e0 con 0x7fd83014e860 2023-06-23T18:50:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd836533640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8300b5fc0 con 0x7fd8300bce00 2023-06-23T18:50:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd836533640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300a64c0 con 0x7fd8300706f0 2023-06-23T18:50:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd83014e860 0x7fd83006f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46158/0 (socket says 172.21.15.38:46158) 2023-06-23T18:50:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82ffff640 1 -- 172.21.15.38:0/49615701 learned_addr learned my addr 172.21.15.38:0/49615701 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:42.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82f7fe640 1 --2- 172.21.15.38:0/49615701 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699398015 0 0) 0x7fd8300a61e0 con 0x7fd83014e860 2023-06-23T18:50:42.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818003530 con 0x7fd83014e860 2023-06-23T18:50:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320893561 0 0) 0x7fd8300b5fc0 con 0x7fd8300bce00 2023-06-23T18:50:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8300a61e0 con 0x7fd8300bce00 2023-06-23T18:50:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82f7fe640 1 -- 172.21.15.38:0/49615701 >> v1:172.21.15.81:6789/0 conn(0x7fd8300bce00 legacy=0x7fd83014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82f7fe640 1 -- 172.21.15.38:0/49615701 >> v1:172.21.15.38:6789/0 conn(0x7fd83014e860 legacy=0x7fd83006f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82f7fe640 1 -- 172.21.15.38:0/49615701 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83014ec30 con 0x7fd8300706f0 2023-06-23T18:50:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82f7fe640 1 --2- 172.21.15.38:0/49615701 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014f080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097f0 tx=0x7fd82401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efc1af3f6ac0e8f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.087+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240ab600 con 0x7fd8300706f0 2023-06-23T18:50:42.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240a7050 con 0x7fd8300706f0 2023-06-23T18:50:42.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82effd640 1 -- 172.21.15.38:0/49615701 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240ab960 con 0x7fd8300706f0 2023-06-23T18:50:42.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/49615701 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 msgr2=0x7fd83014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 --2- 172.21.15.38:0/49615701 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014f080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097f0 tx=0x7fd82401c4c0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/49615701 shutdown_connections 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 --2- 172.21.15.38:0/49615701 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014f080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/49615701 >> 172.21.15.38:0/49615701 conn(0x7fd8300bd9a0 msgr2=0x7fd8300bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/49615701 shutdown_connections 2023-06-23T18:50:42.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/49615701 wait complete. 2023-06-23T18:50:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 Processor -- start 2023-06-23T18:50:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- start start 2023-06-23T18:50:42.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 0x7fd8300b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830146bd0 con 0x7fd8300bce00 2023-06-23T18:50:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83014dcf0 con 0x7fd83014e860 2023-06-23T18:50:42.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd830146860 con 0x7fd8300706f0 2023-06-23T18:50:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37496/0 (socket says 172.21.15.38:37496) 2023-06-23T18:50:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 -- 172.21.15.38:0/2114051865 learned_addr learned my addr 172.21.15.38:0/2114051865 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd834ad0640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 0x7fd8300b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82ffff640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 -- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 msgr2=0x7fd83014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 -- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 msgr2=0x7fd8300b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 0x7fd8300b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 -- 172.21.15.38:0/2114051865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009420 con 0x7fd8300bce00 2023-06-23T18:50:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd834ad0640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 0x7fd8300b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82f7fe640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd8240190d0 tx=0x7fd824019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824003ab0 con 0x7fd8300bce00 2023-06-23T18:50:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824003c10 con 0x7fd8300bce00 2023-06-23T18:50:42.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8301457a0 con 0x7fd8300bce00 2023-06-23T18:50:42.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240ab400 con 0x7fd8300bce00 2023-06-23T18:50:42.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.091+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd830147060 con 0x7fd8300bce00 2023-06-23T18:50:42.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830146690 con 0x7fd8300bce00 2023-06-23T18:50:42.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8240b2040 con 0x7fd8300bce00 2023-06-23T18:50:42.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd82cff9640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 0x7fd81c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd82411e840 con 0x7fd8300bce00 2023-06-23T18:50:42.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd82ffff640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 0x7fd81c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.095+0000 7fd82ffff640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 0x7fd81c068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f70 tx=0x7fd820009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.099+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8240ebc60 con 0x7fd8300bce00 2023-06-23T18:50:42.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.247+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd830073720 con 0x7fd81c0662b0 2023-06-23T18:50:42.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd82cff9640 1 -- 172.21.15.38:0/2114051865 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd830073720 con 0x7fd81c0662b0 2023-06-23T18:50:42.259 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 3 to deep-scrub 2023-06-23T18:50:42.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 msgr2=0x7fd81c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 0x7fd81c068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f70 tx=0x7fd820009040 comp rx=0 tx=0).stop 2023-06-23T18:50:42.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 msgr2=0x7fd8300b7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd8240190d0 tx=0x7fd824019260 comp rx=0 tx=0).stop 2023-06-23T18:50:42.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 shutdown_connections 2023-06-23T18:50:42.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd81c0662b0 0x7fd81c068760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd83014e860 0x7fd8300b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8300bce00 0x7fd8300b7ec0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 --2- 172.21.15.38:0/2114051865 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8300706f0 0x7fd83014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 >> 172.21.15.38:0/2114051865 conn(0x7fd8300bd9a0 msgr2=0x7fd8300bdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 shutdown_connections 2023-06-23T18:50:42.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.251+0000 7fd836533640 1 -- 172.21.15.38:0/2114051865 wait complete. 2023-06-23T18:50:42.276 INFO:tasks.ceph:Scrubbing osd.4 2023-06-23T18:50:42.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 Processor -- start 2023-06-23T18:50:42.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 -- start start 2023-06-23T18:50:42.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc4d006c6d0 0x7fc4d00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00bd410 con 0x7fc4d006a630 2023-06-23T18:50:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00a53a0 con 0x7fc4d0071290 2023-06-23T18:50:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d833e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d0151a00 con 0x7fc4d006c6d0 2023-06-23T18:50:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d60da640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc4d006c6d0 0x7fc4d00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d68db640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc4d006a630 0x7fc4d014e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46174/0 (socket says 172.21.15.38:46174) 2023-06-23T18:50:42.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d68db640 1 -- 172.21.15.38:0/260413721 learned_addr learned my addr 172.21.15.38:0/260413721 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d60da640 1 -- 172.21.15.38:0/260413721 >> v1:172.21.15.81:6789/0 conn(0x7fc4d0071290 legacy=0x7fc4d00b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d60da640 1 -- 172.21.15.38:0/260413721 >> v1:172.21.15.38:6789/0 conn(0x7fc4d006a630 legacy=0x7fc4d014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.395+0000 7fc4d60da640 1 -- 172.21.15.38:0/260413721 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d006a310 con 0x7fc4d006c6d0 2023-06-23T18:50:42.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- 172.21.15.38:0/260413721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006c6d0 0x7fc4d00b93e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009d90 tx=0x7fc4c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35880bb01779bcc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d50d8640 1 -- 172.21.15.38:0/260413721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a57d0 con 0x7fc4d006c6d0 2023-06-23T18:50:42.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d50d8640 1 -- 172.21.15.38:0/260413721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80a5930 con 0x7fc4d006c6d0 2023-06-23T18:50:42.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d50d8640 1 -- 172.21.15.38:0/260413721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a5cc0 con 0x7fc4d006c6d0 2023-06-23T18:50:42.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/260413721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006c6d0 msgr2=0x7fc4d00b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 --2- 172.21.15.38:0/260413721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006c6d0 0x7fc4d00b93e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009d90 tx=0x7fc4c801c910 comp rx=0 tx=0).stop 2023-06-23T18:50:42.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/260413721 shutdown_connections 2023-06-23T18:50:42.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 --2- 172.21.15.38:0/260413721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006c6d0 0x7fc4d00b93e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/260413721 >> 172.21.15.38:0/260413721 conn(0x7fc4d00c0c90 msgr2=0x7fc4d00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/260413721 shutdown_connections 2023-06-23T18:50:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/260413721 wait complete. 2023-06-23T18:50:42.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 Processor -- start 2023-06-23T18:50:42.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- start start 2023-06-23T18:50:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 0x7fc4d0141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4d006c6d0 0x7fc4d013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4d0071290 0x7fc4d013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01421e0 con 0x7fc4d006a630 2023-06-23T18:50:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d0140120 con 0x7fc4d006c6d0 2023-06-23T18:50:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00bf310 con 0x7fc4d0071290 2023-06-23T18:50:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 0x7fc4d0141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 0x7fc4d0141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37524/0 (socket says 172.21.15.38:37524) 2023-06-23T18:50:42.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 -- 172.21.15.38:0/3274461536 learned_addr learned my addr 172.21.15.38:0/3274461536 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:42.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 -- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4d0071290 msgr2=0x7fc4d013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4d0071290 0x7fc4d013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 -- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4d006c6d0 msgr2=0x7fc4d013f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d58d9640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4d006c6d0 0x7fc4d013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4d006c6d0 0x7fc4d013f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8009a70 con 0x7fc4d006a630 2023-06-23T18:50:42.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d60da640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 0x7fc4d0141ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80b0040 tx=0x7fc4c80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ad850 con 0x7fc4d006a630 2023-06-23T18:50:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80ad9b0 con 0x7fc4d006a630 2023-06-23T18:50:42.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80add60 con 0x7fc4d006a630 2023-06-23T18:50:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00bf5f0 con 0x7fc4d006a630 2023-06-23T18:50:42.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.399+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00befe0 con 0x7fc4d006a630 2023-06-23T18:50:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4d00ba240 con 0x7fc4d006a630 2023-06-23T18:50:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4c80b4050 con 0x7fc4d006a630 2023-06-23T18:50:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc4b40662b0 0x7fc4b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc4c811f600 con 0x7fc4d006a630 2023-06-23T18:50:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7fc4b406ff00 0x7fc4b4072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4b4072a00 con 0x7fc4b406ff00 2023-06-23T18:50:42.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c811f970 con 0x7fc4d006a630 2023-06-23T18:50:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4d58d9640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc4b40662b0 0x7fc4b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4d68db640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7fc4b406ff00 0x7fc4b4072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4d58d9640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc4b40662b0 0x7fc4b4068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0141170 tx=0x7fc4c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.403+0000 7fc4d68db640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7fc4b406ff00 0x7fc4b4072330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.407+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== osd.4 v2:172.21.15.81:6800/933345311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc4b4072a00 con 0x7fc4b406ff00 2023-06-23T18:50:42.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 --> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc4d004d790 con 0x7fc4b406ff00 2023-06-23T18:50:42.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4c6ffd640 1 -- 172.21.15.38:0/3274461536 <== osd.4 v2:172.21.15.81:6800/933345311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc4d004d790 con 0x7fc4b406ff00 2023-06-23T18:50:42.432 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:42.433 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:42.433 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:42.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7fc4b406ff00 msgr2=0x7fc4b4072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6800/933345311,v1:172.21.15.81:6801/933345311] conn(0x7fc4b406ff00 0x7fc4b4072330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc4b40662b0 msgr2=0x7fc4b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc4b40662b0 0x7fc4b4068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0141170 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2023-06-23T18:50:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 msgr2=0x7fc4d0141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 --2- 172.21.15.38:0/3274461536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4d006a630 0x7fc4d0141ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80b0040 tx=0x7fc4c80196b0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d68db640 1 -- 172.21.15.38:0/3274461536 reap_dead start 2023-06-23T18:50:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 shutdown_connections 2023-06-23T18:50:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 >> 172.21.15.38:0/3274461536 conn(0x7fc4d00c0c90 msgr2=0x7fc4d00b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 shutdown_connections 2023-06-23T18:50:42.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.419+0000 7fc4d833e640 1 -- 172.21.15.38:0/3274461536 wait complete. 2023-06-23T18:50:42.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-06-23T18:50:42.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 Processor -- start 2023-06-23T18:50:42.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 -- start start 2023-06-23T18:50:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce1006c6d0 0x7fce100b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 0x7fce1014e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100bd410 con 0x7fce10071290 2023-06-23T18:50:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce100a53a0 con 0x7fce1006c6d0 2023-06-23T18:50:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce165e3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce10151a00 con 0x7fce1006a630 2023-06-23T18:50:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fce10071290 0x7fce100b9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46182/0 (socket says 172.21.15.38:46182) 2023-06-23T18:50:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0f7fe640 1 -- 172.21.15.38:0/2854529764 learned_addr learned my addr 172.21.15.38:0/2854529764 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 0x7fce1014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0ffff640 1 --2- 172.21.15.38:0/2854529764 >> v2:172.21.15.81:3300/0 conn(0x7fce1006c6d0 0x7fce100b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158270651 0 0) 0x7fce100bd410 con 0x7fce10071290 2023-06-23T18:50:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003530 con 0x7fce10071290 2023-06-23T18:50:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141971630 0 0) 0x7fcdf8003530 con 0x7fce10071290 2023-06-23T18:50:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 msgr2=0x7fce1014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 0x7fce1014e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 >> v2:172.21.15.81:3300/0 conn(0x7fce1006c6d0 msgr2=0x7fce100b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 --2- 172.21.15.38:0/2854529764 >> v2:172.21.15.81:3300/0 conn(0x7fce1006c6d0 0x7fce100b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1006a310 con 0x7fce10071290 2023-06-23T18:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fce04001680 con 0x7fce10071290 2023-06-23T18:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 >> v1:172.21.15.38:6789/0 conn(0x7fce10071290 legacy=0x7fce100b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 0x7fcdf8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8003f00 0x7fcdf80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf8004d10 0x7fcdf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100a53a0 con 0x7fcdf8004d10 2023-06-23T18:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce10151a00 con 0x7fcdf8003f00 2023-06-23T18:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800b990 con 0x7fce1006a630 2023-06-23T18:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf8004d10 0x7fcdf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce0f7fe640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8003f00 0x7fcdf80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 -- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 msgr2=0x7fcdf8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce1006a630 0x7fcdf8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 -- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8003f00 msgr2=0x7fcdf80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8003f00 0x7fcdf80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.543+0000 7fce14b80640 1 -- 172.21.15.38:0/2854529764 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8003530 con 0x7fcdf8004d10 2023-06-23T18:50:42.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce14b80640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf8004d10 0x7fcdf8005180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fce00009fc0 tx=0x7fce0001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224814cf4b7c974c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000a5cb0 con 0x7fcdf8004d10 2023-06-23T18:50:42.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0000f040 con 0x7fcdf8004d10 2023-06-23T18:50:42.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0effd640 1 -- 172.21.15.38:0/2854529764 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000ad680 con 0x7fcdf8004d10 2023-06-23T18:50:42.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- 172.21.15.38:0/2854529764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf8004d10 msgr2=0x7fcdf8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 --2- 172.21.15.38:0/2854529764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcdf8004d10 0x7fcdf8005180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fce00009fc0 tx=0x7fce0001cca0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce14b80640 1 -- 172.21.15.38:0/2854529764 reap_dead start 2023-06-23T18:50:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- 172.21.15.38:0/2854529764 shutdown_connections 2023-06-23T18:50:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- 172.21.15.38:0/2854529764 >> 172.21.15.38:0/2854529764 conn(0x7fce100c0c90 msgr2=0x7fce100bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- 172.21.15.38:0/2854529764 shutdown_connections 2023-06-23T18:50:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- 172.21.15.38:0/2854529764 wait complete. 2023-06-23T18:50:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 Processor -- start 2023-06-23T18:50:42.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- start start 2023-06-23T18:50:42.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8004d10 0x7fce1014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce100bf700 0x7fce1013f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce101e3510 con 0x7fce1014efe0 2023-06-23T18:50:42.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce101e3140 con 0x7fcdf8004d10 2023-06-23T18:50:42.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce165e3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce101e7490 con 0x7fce100bf700 2023-06-23T18:50:42.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8004d10 0x7fce1014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37540/0 (socket says 172.21.15.38:37540) 2023-06-23T18:50:42.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce14b80640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce100bf700 0x7fce1013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 -- 172.21.15.38:0/2216265814 learned_addr learned my addr 172.21.15.38:0/2216265814 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:42.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 -- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce100bf700 msgr2=0x7fce1013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce100bf700 0x7fce1013f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 -- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8004d10 msgr2=0x7fce1014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8004d10 0x7fce1014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.547+0000 7fce0f7fe640 1 -- 172.21.15.38:0/2216265814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce101e7110 con 0x7fce1014efe0 2023-06-23T18:50:42.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0f7fe640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d900 tx=0x7fce0400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04007560 con 0x7fce1014efe0 2023-06-23T18:50:42.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040076c0 con 0x7fce1014efe0 2023-06-23T18:50:42.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04004a10 con 0x7fce1014efe0 2023-06-23T18:50:42.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce100bfb70 con 0x7fce1014efe0 2023-06-23T18:50:42.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1013f860 con 0x7fce1014efe0 2023-06-23T18:50:42.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce101e3280 con 0x7fce1014efe0 2023-06-23T18:50:42.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce04004b70 con 0x7fce1014efe0 2023-06-23T18:50:42.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce04083a00 con 0x7fce1014efe0 2023-06-23T18:50:42.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0ffff640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.551+0000 7fce0ffff640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 0x7fcdfc068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce080093f0 tx=0x7fce080094c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.555+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce04050d90 con 0x7fce1014efe0 2023-06-23T18:50:42.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.703+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fce100ba030 con 0x7fcdfc066280 2023-06-23T18:50:42.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.703+0000 7fce0cff9640 1 -- 172.21.15.38:0/2216265814 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce08011a10 con 0x7fcdfc066280 2023-06-23T18:50:42.714 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 4 to deep-scrub 2023-06-23T18:50:42.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 msgr2=0x7fcdfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 0x7fcdfc068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce080093f0 tx=0x7fce080094c0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 msgr2=0x7fce1014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d900 tx=0x7fce0400ddc0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 shutdown_connections 2023-06-23T18:50:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce100bf700 0x7fce1013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce1014efe0 0x7fce1014d200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 --2- 172.21.15.38:0/2216265814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf8004d10 0x7fce1014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 >> 172.21.15.38:0/2216265814 conn(0x7fce100c0c90 msgr2=0x7fce10151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 shutdown_connections 2023-06-23T18:50:42.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.707+0000 7fce165e3640 1 -- 172.21.15.38:0/2216265814 wait complete. 2023-06-23T18:50:42.731 INFO:tasks.ceph:Scrubbing osd.5 2023-06-23T18:50:42.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:42.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 Processor -- start 2023-06-23T18:50:42.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 -- start start 2023-06-23T18:50:42.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f564014da50 0x7f5640069470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400b5d70 con 0x7f56400b68a0 2023-06-23T18:50:42.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564014f260 con 0x7f56400bcc00 2023-06-23T18:50:42.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f5646b6f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400bb230 con 0x7f564014da50 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564510c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f56400b68a0 0x7f56400b6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46194/0 (socket says 172.21.15.38:46194) 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564490b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f564014da50 0x7f5640069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564510c640 1 -- 172.21.15.38:0/2458597241 learned_addr learned my addr 172.21.15.38:0/2458597241 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f563f7fe640 1 -- 172.21.15.38:0/2458597241 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926975917 0 0) 0x7f56400b5d70 con 0x7f56400b68a0 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f563f7fe640 1 -- 172.21.15.38:0/2458597241 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628003530 con 0x7f56400b68a0 2023-06-23T18:50:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564490b640 1 -- 172.21.15.38:0/2458597241 >> v1:172.21.15.81:6789/0 conn(0x7f56400bcc00 legacy=0x7f564014eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564490b640 1 -- 172.21.15.38:0/2458597241 >> v1:172.21.15.38:6789/0 conn(0x7f56400b68a0 legacy=0x7f56400b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564490b640 1 -- 172.21.15.38:0/2458597241 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400bb510 con 0x7f564014da50 2023-06-23T18:50:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.843+0000 7f564490b640 1 --2- 172.21.15.38:0/2458597241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564014da50 0x7f5640069470 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f84b64745df487 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563f7fe640 1 -- 172.21.15.38:0/2458597241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300ab600 con 0x7f564014da50 2023-06-23T18:50:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563f7fe640 1 -- 172.21.15.38:0/2458597241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300a7050 con 0x7f564014da50 2023-06-23T18:50:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563f7fe640 1 -- 172.21.15.38:0/2458597241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300ab980 con 0x7f564014da50 2023-06-23T18:50:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/2458597241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564014da50 msgr2=0x7f5640069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 --2- 172.21.15.38:0/2458597241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564014da50 0x7f5640069470 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001c3b0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/2458597241 shutdown_connections 2023-06-23T18:50:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 --2- 172.21.15.38:0/2458597241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f564014da50 0x7f5640069470 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/2458597241 >> 172.21.15.38:0/2458597241 conn(0x7f56400bd1b0 msgr2=0x7f56400bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/2458597241 shutdown_connections 2023-06-23T18:50:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/2458597241 wait complete. 2023-06-23T18:50:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 Processor -- start 2023-06-23T18:50:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- start start 2023-06-23T18:50:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f56400b68a0 0x7f5640143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 0x7f5640140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640140280 0x7f56401410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400a3bf0 con 0x7f56400bcc00 2023-06-23T18:50:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640144800 con 0x7f5640140280 2023-06-23T18:50:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5640143240 con 0x7f56400b68a0 2023-06-23T18:50:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 0x7f5640140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 0x7f5640140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37552/0 (socket says 172.21.15.38:37552) 2023-06-23T18:50:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 -- 172.21.15.38:0/3865787980 learned_addr learned my addr 172.21.15.38:0/3865787980 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 -- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f56400b68a0 msgr2=0x7f5640143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f564490b640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f56400b68a0 0x7f5640143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f564510c640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640140280 0x7f56401410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f56400b68a0 0x7f5640143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 -- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640140280 msgr2=0x7f56401410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640140280 0x7f56401410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009420 con 0x7f56400bcc00 2023-06-23T18:50:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563ffff640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 0x7f5640140ba0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563400c4b0 tx=0x7f563400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634012830 con 0x7f56400bcc00 2023-06-23T18:50:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340129b0 con 0x7f56400bcc00 2023-06-23T18:50:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5640143800 con 0x7f56400bcc00 2023-06-23T18:50:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634012d60 con 0x7f56400bcc00 2023-06-23T18:50:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5640141680 con 0x7f56400bcc00 2023-06-23T18:50:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.847+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56400b7410 con 0x7f56400bcc00 2023-06-23T18:50:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f563401c460 con 0x7f56400bcc00 2023-06-23T18:50:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f562c0662b0 0x7f562c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5634084750 con 0x7f56400bcc00 2023-06-23T18:50:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7f562c06ff00 0x7f562c072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f562c072a00 con 0x7f562c06ff00 2023-06-23T18:50:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5634084ac0 con 0x7f56400bcc00 2023-06-23T18:50:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f564490b640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f562c0662b0 0x7f562c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f564510c640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7f562c06ff00 0x7f562c072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:42.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f564490b640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f562c0662b0 0x7f562c068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56300ad000 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f564510c640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7f562c06ff00 0x7f562c072330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.851+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== osd.5 v2:172.21.15.81:6808/3054646995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f562c072a00 con 0x7f562c06ff00 2023-06-23T18:50:42.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.863+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 --> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5640143660 con 0x7f562c06ff00 2023-06-23T18:50:42.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f563d7fa640 1 -- 172.21.15.38:0/3865787980 <== osd.5 v2:172.21.15.81:6808/3054646995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f56380070f0 con 0x7f562c06ff00 2023-06-23T18:50:42.876 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:42.876 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:42.876 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7f562c06ff00 msgr2=0x7f562c072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6808/3054646995,v1:172.21.15.81:6809/3054646995] conn(0x7f562c06ff00 0x7f562c072330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f562c0662b0 msgr2=0x7f562c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f562c0662b0 0x7f562c068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56300ad000 tx=0x7f5630008040 comp rx=0 tx=0).stop 2023-06-23T18:50:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 msgr2=0x7f5640140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 --2- 172.21.15.38:0/3865787980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56400bcc00 0x7f5640140ba0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563400c4b0 tx=0x7f563400c970 comp rx=0 tx=0).stop 2023-06-23T18:50:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f564510c640 1 -- 172.21.15.38:0/3865787980 reap_dead start 2023-06-23T18:50:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 shutdown_connections 2023-06-23T18:50:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 >> 172.21.15.38:0/3865787980 conn(0x7f56400bd1b0 msgr2=0x7f56400b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 shutdown_connections 2023-06-23T18:50:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:42.867+0000 7f5646b6f640 1 -- 172.21.15.38:0/3865787980 wait complete. 2023-06-23T18:50:42.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-06-23T18:50:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 Processor -- start 2023-06-23T18:50:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 -- start start 2023-06-23T18:50:43.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac14e860 0x7fe9ac14f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9ac0706f0 0x7fe9ac06f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe9ac0bce00 0x7fe9ac0bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac0a64c0 con 0x7fe9ac0bce00 2023-06-23T18:50:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac06f8a0 con 0x7fe9ac0706f0 2023-06-23T18:50:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9b1d2f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0a61e0 con 0x7fe9ac14e860 2023-06-23T18:50:43.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe9ac0bce00 0x7fe9ac0bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe9ac0bce00 0x7fe9ac0bd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37556/0 (socket says 172.21.15.38:37556) 2023-06-23T18:50:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 -- 172.21.15.38:0/223327586 learned_addr learned my addr 172.21.15.38:0/223327586 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9ab7fe640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac14e860 0x7fe9ac14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9aaffd640 1 --2- 172.21.15.38:0/223327586 >> v2:172.21.15.81:3300/0 conn(0x7fe9ac0706f0 0x7fe9ac06f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 -- 172.21.15.38:0/223327586 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac14e860 msgr2=0x7fe9ac14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:43.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac14e860 0x7fe9ac14f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 -- 172.21.15.38:0/223327586 >> v2:172.21.15.81:3300/0 conn(0x7fe9ac0706f0 msgr2=0x7fe9ac06f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:43.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 --2- 172.21.15.38:0/223327586 >> v2:172.21.15.81:3300/0 conn(0x7fe9ac0706f0 0x7fe9ac06f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.003+0000 7fe9abfff640 1 -- 172.21.15.38:0/223327586 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0b5fc0 con 0x7fe9ac0bce00 2023-06-23T18:50:43.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0bce00 0x7fe9ac0bd260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac06dbc0 tx=0x7fe9a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9951b1479f577fa0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9aa7fc640 1 -- 172.21.15.38:0/223327586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40a5870 con 0x7fe9ac0bce00 2023-06-23T18:50:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9aa7fc640 1 -- 172.21.15.38:0/223327586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a40a59d0 con 0x7fe9ac0bce00 2023-06-23T18:50:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9aa7fc640 1 -- 172.21.15.38:0/223327586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40a5d60 con 0x7fe9ac0bce00 2023-06-23T18:50:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/223327586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0bce00 msgr2=0x7fe9ac0bd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0bce00 0x7fe9ac0bd260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac06dbc0 tx=0x7fe9a401c9d0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/223327586 shutdown_connections 2023-06-23T18:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0bce00 0x7fe9ac0bd260 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/223327586 >> v2:172.21.15.81:3300/0 conn(0x7fe9ac0706f0 0x7fe9ac06f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/223327586 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac14e860 0x7fe9ac14f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/223327586 >> 172.21.15.38:0/223327586 conn(0x7fe9ac0bd9a0 msgr2=0x7fe9ac0bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/223327586 shutdown_connections 2023-06-23T18:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/223327586 wait complete. 2023-06-23T18:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 Processor -- start 2023-06-23T18:50:43.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- start start 2023-06-23T18:50:43.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9ac0706f0 0x7fe9ac1416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 0x7fe9ac147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac147f50 con 0x7fe9ac14e860 2023-06-23T18:50:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac148c50 con 0x7fe9ac0706f0 2023-06-23T18:50:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac1425c0 con 0x7fe9ac0bce00 2023-06-23T18:50:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37558/0 (socket says 172.21.15.38:37558) 2023-06-23T18:50:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 -- 172.21.15.38:0/3906194747 learned_addr learned my addr 172.21.15.38:0/3906194747 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9ab7fe640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9ac0706f0 0x7fe9ac1416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9aaffd640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 0x7fe9ac147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 -- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 msgr2=0x7fe9ac147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 0x7fe9ac147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 -- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9ac0706f0 msgr2=0x7fe9ac1416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9ac0706f0 0x7fe9ac1416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 -- 172.21.15.38:0/3906194747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4009b30 con 0x7fe9ac14e860 2023-06-23T18:50:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9aaffd640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 0x7fe9ac147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9abfff640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40af040 tx=0x7fe9a4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40b8880 con 0x7fe9ac14e860 2023-06-23T18:50:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a40b8a00 con 0x7fe9ac14e860 2023-06-23T18:50:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac141c10 con 0x7fe9ac14e860 2023-06-23T18:50:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40b8db0 con 0x7fe9ac14e860 2023-06-23T18:50:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.007+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac142200 con 0x7fe9ac14e860 2023-06-23T18:50:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac073720 con 0x7fe9ac14e860 2023-06-23T18:50:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9a4007470 con 0x7fe9ac14e860 2023-06-23T18:50:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe993fff640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9a411fb00 con 0x7fe9ac14e860 2023-06-23T18:50:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe9ab7fe640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.011+0000 7fe9ab7fe640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 0x7fe998068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac140f80 tx=0x7fe99c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.015+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9a40eccb0 con 0x7fe9ac14e860 2023-06-23T18:50:43.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.163+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ac04d790 con 0x7fe998066280 2023-06-23T18:50:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.163+0000 7fe993fff640 1 -- 172.21.15.38:0/3906194747 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe9ac04d790 con 0x7fe998066280 2023-06-23T18:50:43.173 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 5 to deep-scrub 2023-06-23T18:50:43.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 msgr2=0x7fe998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 0x7fe998068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac140f80 tx=0x7fe99c008040 comp rx=0 tx=0).stop 2023-06-23T18:50:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 msgr2=0x7fe9ac147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40af040 tx=0x7fe9a4019770 comp rx=0 tx=0).stop 2023-06-23T18:50:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 shutdown_connections 2023-06-23T18:50:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fe998066280 0x7fe998068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac14e860 0x7fe9ac147590 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe9ac0bce00 0x7fe9ac147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 --2- 172.21.15.38:0/3906194747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9ac0706f0 0x7fe9ac1416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 >> 172.21.15.38:0/3906194747 conn(0x7fe9ac0bd9a0 msgr2=0x7fe9ac145d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 shutdown_connections 2023-06-23T18:50:43.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.167+0000 7fe9b1d2f640 1 -- 172.21.15.38:0/3906194747 wait complete. 2023-06-23T18:50:43.191 INFO:tasks.ceph:Scrubbing osd.6 2023-06-23T18:50:43.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:43.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.303+0000 7f25ec592640 1 Processor -- start 2023-06-23T18:50:43.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.303+0000 7f25ec592640 1 -- start start 2023-06-23T18:50:43.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ec592640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e40bea40 0x7f25e40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ec592640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 0x7f25e40c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ec592640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e4152830 con 0x7f25e40bee10 2023-06-23T18:50:43.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ec592640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40c22a0 con 0x7f25e40bea40 2023-06-23T18:50:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ec592640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40c2870 con 0x7f25e40a30c0 2023-06-23T18:50:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e40bea40 0x7f25e40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e40bea40 0x7f25e40a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37562/0 (socket says 172.21.15.38:37562) 2023-06-23T18:50:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25eab2f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f25e40bee10 0x7f25e406a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46208/0 (socket says 172.21.15.38:46208) 2023-06-23T18:50:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 -- 172.21.15.38:0/1099720195 learned_addr learned my addr 172.21.15.38:0/1099720195 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25e9b2d640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 0x7f25e40c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 -- 172.21.15.38:0/1099720195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 msgr2=0x7f25e40c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 0x7f25e40c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 -- 172.21.15.38:0/1099720195 >> v1:172.21.15.38:6789/0 conn(0x7f25e40bee10 legacy=0x7f25e406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 -- 172.21.15.38:0/1099720195 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e40b7950 con 0x7f25e40bea40 2023-06-23T18:50:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25e9b2d640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 0x7f25e40c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25ea32e640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e40a35f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7884979ab4a7b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25e932c640 1 -- 172.21.15.38:0/1099720195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40ab600 con 0x7f25e40bea40 2023-06-23T18:50:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25e932c640 1 -- 172.21.15.38:0/1099720195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d40a7050 con 0x7f25e40bea40 2023-06-23T18:50:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.307+0000 7f25e932c640 1 -- 172.21.15.38:0/1099720195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40ab980 con 0x7f25e40bea40 2023-06-23T18:50:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1099720195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 msgr2=0x7f25e40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e40a35f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d401c4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1099720195 shutdown_connections 2023-06-23T18:50:43.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40a30c0 0x7f25e40c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- 172.21.15.38:0/1099720195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e40a35f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1099720195 >> 172.21.15.38:0/1099720195 conn(0x7f25e40a5cc0 msgr2=0x7f25e40a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1099720195 shutdown_connections 2023-06-23T18:50:43.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1099720195 wait complete. 2023-06-23T18:50:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 Processor -- start 2023-06-23T18:50:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- start start 2023-06-23T18:50:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e40a30c0 0x7f25e40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e41473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40bee10 0x7f25e41e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40a7ee0 con 0x7f25e40bea40 2023-06-23T18:50:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40a7b70 con 0x7f25e40a30c0 2023-06-23T18:50:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40a7730 con 0x7f25e40bee10 2023-06-23T18:50:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e41473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e41473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37570/0 (socket says 172.21.15.38:37570) 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 -- 172.21.15.38:0/1527519180 learned_addr learned my addr 172.21.15.38:0/1527519180 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ea32e640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e40a30c0 0x7f25e40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25eab2f640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40bee10 0x7f25e41e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 -- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40bee10 msgr2=0x7f25e41e95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25e40bee10 0x7f25e41e95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 -- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e40a30c0 msgr2=0x7f25e40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e40a30c0 0x7f25e40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40094d0 con 0x7f25e40bea40 2023-06-23T18:50:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25e9b2d640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e41473f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f25e000e810 tx=0x7f25e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000c8d0 con 0x7f25e40bea40 2023-06-23T18:50:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000ca30 con 0x7f25e40bea40 2023-06-23T18:50:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e40b7250 con 0x7f25e40bea40 2023-06-23T18:50:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000cdc0 con 0x7f25e40bea40 2023-06-23T18:50:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.311+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e40a9ef0 con 0x7f25e40bea40 2023-06-23T18:50:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25e40c3990 con 0x7f25e40bea40 2023-06-23T18:50:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25e0026480 con 0x7f25e40bea40 2023-06-23T18:50:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25c80662b0 0x7f25c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25e0084210 con 0x7f25e40bea40 2023-06-23T18:50:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f25c806ff00 0x7f25c8072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25c8072a00 con 0x7f25c806ff00 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25e0084660 con 0x7f25e40bea40 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25ea32e640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25c80662b0 0x7f25c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25eab2f640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f25c806ff00 0x7f25c8072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25ea32e640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25c80662b0 0x7f25c8068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f25d40ad000 tx=0x7f25d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.315+0000 7f25eab2f640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f25c806ff00 0x7f25c8072330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.319+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== osd.6 v2:172.21.15.81:6816/3000886383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f25c8072a00 con 0x7f25c806ff00 2023-06-23T18:50:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 --> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25e40a7d30 con 0x7f25c806ff00 2023-06-23T18:50:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25daffd640 1 -- 172.21.15.38:0/1527519180 <== osd.6 v2:172.21.15.81:6816/3000886383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f25e40a7d30 con 0x7f25c806ff00 2023-06-23T18:50:43.341 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:43.341 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:43.342 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f25c806ff00 msgr2=0x7f25c8072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6816/3000886383,v1:172.21.15.81:6817/3000886383] conn(0x7f25c806ff00 0x7f25c8072330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25c80662b0 msgr2=0x7f25c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f25c80662b0 0x7f25c8068760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f25d40ad000 tx=0x7f25d4008040 comp rx=0 tx=0).stop 2023-06-23T18:50:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 msgr2=0x7f25e41473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 --2- 172.21.15.38:0/1527519180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e40bea40 0x7f25e41473f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f25e000e810 tx=0x7f25e000ecd0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25eab2f640 1 -- 172.21.15.38:0/1527519180 reap_dead start 2023-06-23T18:50:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 shutdown_connections 2023-06-23T18:50:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 >> 172.21.15.38:0/1527519180 conn(0x7f25e40a5cc0 msgr2=0x7f25e4151690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 shutdown_connections 2023-06-23T18:50:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.331+0000 7f25ec592640 1 -- 172.21.15.38:0/1527519180 wait complete. 2023-06-23T18:50:43.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-06-23T18:50:43.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 Processor -- start 2023-06-23T18:50:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 -- start start 2023-06-23T18:50:43.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc3f006e580 0x7fc3f006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f00bd220 con 0x7fc3f00bca30 2023-06-23T18:50:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f006dd70 con 0x7fc3f014b630 2023-06-23T18:50:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f7933640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f006da60 con 0x7fc3f006e580 2023-06-23T18:50:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f4ece640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc3f00bca30 0x7fc3f006d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46210/0 (socket says 172.21.15.38:46210) 2023-06-23T18:50:43.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f4ece640 1 -- 172.21.15.38:0/1830593481 learned_addr learned my addr 172.21.15.38:0/1830593481 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f5ed0640 1 --2- 172.21.15.38:0/1830593481 >> v2:172.21.15.38:3300/0 conn(0x7fc3f006e580 0x7fc3f006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3e7fff640 1 -- 172.21.15.38:0/1830593481 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366325843 0 0) 0x7fc3f00bd220 con 0x7fc3f00bca30 2023-06-23T18:50:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3e7fff640 1 -- 172.21.15.38:0/1830593481 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3dc003530 con 0x7fc3f00bca30 2023-06-23T18:50:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f5ed0640 1 -- 172.21.15.38:0/1830593481 >> v1:172.21.15.81:6789/0 conn(0x7fc3f014b630 legacy=0x7fc3f014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f5ed0640 1 -- 172.21.15.38:0/1830593481 >> v1:172.21.15.38:6789/0 conn(0x7fc3f00bca30 legacy=0x7fc3f006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.467+0000 7fc3f5ed0640 1 -- 172.21.15.38:0/1830593481 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0060bf0 con 0x7fc3f006e580 2023-06-23T18:50:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f5ed0640 1 --2- 172.21.15.38:0/1830593481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f006e580 0x7fc3f006fed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097c0 tx=0x7fc3e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332eac77adc391a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3e7fff640 1 -- 172.21.15.38:0/1830593481 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a8050 con 0x7fc3f006e580 2023-06-23T18:50:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3e7fff640 1 -- 172.21.15.38:0/1830593481 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80ac5f0 con 0x7fc3f006e580 2023-06-23T18:50:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3e7fff640 1 -- 172.21.15.38:0/1830593481 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80ac960 con 0x7fc3f006e580 2023-06-23T18:50:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- 172.21.15.38:0/1830593481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f006e580 msgr2=0x7fc3f006fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 --2- 172.21.15.38:0/1830593481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f006e580 0x7fc3f006fed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80097c0 tx=0x7fc3e801c480 comp rx=0 tx=0).stop 2023-06-23T18:50:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- 172.21.15.38:0/1830593481 shutdown_connections 2023-06-23T18:50:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 --2- 172.21.15.38:0/1830593481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f006e580 0x7fc3f006fed0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- 172.21.15.38:0/1830593481 >> 172.21.15.38:0/1830593481 conn(0x7fc3f00c1fb0 msgr2=0x7fc3f00c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- 172.21.15.38:0/1830593481 shutdown_connections 2023-06-23T18:50:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- 172.21.15.38:0/1830593481 wait complete. 2023-06-23T18:50:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 Processor -- start 2023-06-23T18:50:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- start start 2023-06-23T18:50:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3f006e580 0x7fc3f0144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3f014b630 0x7fc3f01459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f0144560 con 0x7fc3f00bca30 2023-06-23T18:50:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f014eb30 con 0x7fc3f006e580 2023-06-23T18:50:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f7933640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f014edd0 con 0x7fc3f014b630 2023-06-23T18:50:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37592/0 (socket says 172.21.15.38:37592) 2023-06-23T18:50:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 -- 172.21.15.38:0/3763070966 learned_addr learned my addr 172.21.15.38:0/3763070966 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f5ed0640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3f014b630 0x7fc3f01459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f56cf640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3f006e580 0x7fc3f0144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 -- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3f014b630 msgr2=0x7fc3f01459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3f014b630 0x7fc3f01459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 -- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3f006e580 msgr2=0x7fc3f0144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3f006e580 0x7fc3f0144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.471+0000 7fc3f4ece640 1 -- 172.21.15.38:0/3763070966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8009420 con 0x7fc3f00bca30 2023-06-23T18:50:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f4ece640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0001ec0 tx=0x7fc3e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0005d50 con 0x7fc3f00bca30 2023-06-23T18:50:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0007070 con 0x7fc3f00bca30 2023-06-23T18:50:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0007420 con 0x7fc3f00bca30 2023-06-23T18:50:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f0144de0 con 0x7fc3f00bca30 2023-06-23T18:50:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f014d870 con 0x7fc3f00bca30 2023-06-23T18:50:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f0144f70 con 0x7fc3f00bca30 2023-06-23T18:50:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3e0007580 con 0x7fc3f00bca30 2023-06-23T18:50:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 0x7fc3d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3e0083130 con 0x7fc3f00bca30 2023-06-23T18:50:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f56cf640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 0x7fc3d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.475+0000 7fc3f56cf640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 0x7fc3d4068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001cb0 tx=0x7fc3ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.479+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3e00504c0 con 0x7fc3f00bca30 2023-06-23T18:50:43.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.631+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3f004d790 con 0x7fc3d40662b0 2023-06-23T18:50:43.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3e5ffb640 1 -- 172.21.15.38:0/3763070966 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3f004d790 con 0x7fc3d40662b0 2023-06-23T18:50:43.644 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 6 to deep-scrub 2023-06-23T18:50:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 msgr2=0x7fc3d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 0x7fc3d4068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001cb0 tx=0x7fc3ec009040 comp rx=0 tx=0).stop 2023-06-23T18:50:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 msgr2=0x7fc3f014d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0001ec0 tx=0x7fc3e000c960 comp rx=0 tx=0).stop 2023-06-23T18:50:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 shutdown_connections 2023-06-23T18:50:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc3d40662b0 0x7fc3d4068760 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3f014b630 0x7fc3f01459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3f00bca30 0x7fc3f014d160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 --2- 172.21.15.38:0/3763070966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3f006e580 0x7fc3f0144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 >> 172.21.15.38:0/3763070966 conn(0x7fc3f00c1fb0 msgr2=0x7fc3f00c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 shutdown_connections 2023-06-23T18:50:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.635+0000 7fc3f7933640 1 -- 172.21.15.38:0/3763070966 wait complete. 2023-06-23T18:50:43.663 INFO:tasks.ceph:Scrubbing osd.7 2023-06-23T18:50:43.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-06-23T18:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 Processor -- start 2023-06-23T18:50:43.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 -- start start 2023-06-23T18:50:43.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ddc14b930 0x7f2ddc06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 0x7f2ddc070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc0ba9d0 con 0x7f2ddc06c9b0 2023-06-23T18:50:43.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0bc300 con 0x7f2ddc14b930 2023-06-23T18:50:43.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de3ac5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0a5570 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1861640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ddc14b930 0x7f2ddc06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de2062640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2ddc06c9b0 0x7f2ddc0707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46214/0 (socket says 172.21.15.38:46214) 2023-06-23T18:50:43.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de2062640 1 -- 172.21.15.38:0/3289248682 learned_addr learned my addr 172.21.15.38:0/3289248682 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1060640 1 --2- 172.21.15.38:0/3289248682 >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 0x7f2ddc070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1861640 1 -- 172.21.15.38:0/3289248682 >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 msgr2=0x7f2ddc070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1861640 1 --2- 172.21.15.38:0/3289248682 >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 0x7f2ddc070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1861640 1 -- 172.21.15.38:0/3289248682 >> v1:172.21.15.38:6789/0 conn(0x7f2ddc06c9b0 legacy=0x7f2ddc0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1861640 1 -- 172.21.15.38:0/3289248682 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc150160 con 0x7f2ddc14b930 2023-06-23T18:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de085f640 1 -- 172.21.15.38:0/3289248682 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865209207 0 0) 0x7f2ddc0ba9d0 con 0x7f2ddc06c9b0 2023-06-23T18:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.783+0000 7f2de1060640 1 --2- 172.21.15.38:0/3289248682 >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 0x7f2ddc070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de1861640 1 --2- 172.21.15.38:0/3289248682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc14b930 0x7f2ddc06c470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0718c0 tx=0x7f2dd401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ed395810ee5865 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de085f640 1 -- 172.21.15.38:0/3289248682 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40a5960 con 0x7f2ddc14b930 2023-06-23T18:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de085f640 1 -- 172.21.15.38:0/3289248682 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd40a5ac0 con 0x7f2ddc14b930 2023-06-23T18:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de085f640 1 -- 172.21.15.38:0/3289248682 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40a5e50 con 0x7f2ddc14b930 2023-06-23T18:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- 172.21.15.38:0/3289248682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc14b930 msgr2=0x7f2ddc06c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/3289248682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc14b930 0x7f2ddc06c470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0718c0 tx=0x7f2dd401c880 comp rx=0 tx=0).stop 2023-06-23T18:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- 172.21.15.38:0/3289248682 shutdown_connections 2023-06-23T18:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/3289248682 >> v2:172.21.15.81:3300/0 conn(0x7f2ddc0bd1e0 0x7f2ddc070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/3289248682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc14b930 0x7f2ddc06c470 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- 172.21.15.38:0/3289248682 >> 172.21.15.38:0/3289248682 conn(0x7f2ddc0c0c90 msgr2=0x7f2ddc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- 172.21.15.38:0/3289248682 shutdown_connections 2023-06-23T18:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- 172.21.15.38:0/3289248682 wait complete. 2023-06-23T18:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 Processor -- start 2023-06-23T18:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.787+0000 7f2de3ac5640 1 -- start start 2023-06-23T18:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ddc06c9b0 0x7f2ddc13f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 0x7f2ddc1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ddc14b930 0x7f2ddc139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc13a030 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc140580 con 0x7f2ddc06c9b0 2023-06-23T18:50:43.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc14f110 con 0x7f2ddc14b930 2023-06-23T18:50:43.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 0x7f2ddc1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 0x7f2ddc1395b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37616/0 (socket says 172.21.15.38:37616) 2023-06-23T18:50:43.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 -- 172.21.15.38:0/1258737173 learned_addr learned my addr 172.21.15.38:0/1258737173 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 -- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ddc14b930 msgr2=0x7f2ddc139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ddc14b930 0x7f2ddc139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 -- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ddc06c9b0 msgr2=0x7f2ddc13f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ddc06c9b0 0x7f2ddc13f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4009a70 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1060640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 0x7f2ddc1395b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c7f0 tx=0x7f2dcc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00cea0 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc007a30 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc13fe20 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007de0 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc14f360 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ddc070eb0 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2dcc0113f0 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2dc00662b0 0x7f2dc0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2dcc0846c0 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f2dc006ff00 0x7f2dc0072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dc0072a00 con 0x7f2dc006ff00 2023-06-23T18:50:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dcc084a30 con 0x7f2ddc0bd1e0 2023-06-23T18:50:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de1861640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2dc00662b0 0x7f2dc0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.791+0000 7f2de2062640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f2dc006ff00 0x7f2dc0072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.795+0000 7f2de1861640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2dc00662b0 0x7f2dc0068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.795+0000 7f2de2062640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f2dc006ff00 0x7f2dc0072330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.795+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== osd.7 v2:172.21.15.81:6824/3767203985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2dc0072a00 con 0x7f2dc006ff00 2023-06-23T18:50:43.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.807+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 --> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ddc04d790 con 0x7f2dc006ff00 2023-06-23T18:50:43.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.807+0000 7f2dd27fc640 1 -- 172.21.15.38:0/1258737173 <== osd.7 v2:172.21.15.81:6824/3767203985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2ddc04d790 con 0x7f2dc006ff00 2023-06-23T18:50:43.819 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-06-23T18:50:43.819 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-23T18:50:43.819 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-06-23T18:50:43.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f2dc006ff00 msgr2=0x7f2dc0072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6824/3767203985,v1:172.21.15.81:6825/3767203985] conn(0x7f2dc006ff00 0x7f2dc0072330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2dc00662b0 msgr2=0x7f2dc0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f2dc00662b0 0x7f2dc0068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4004ac0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 msgr2=0x7f2ddc1395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 --2- 172.21.15.38:0/1258737173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ddc0bd1e0 0x7f2ddc1395b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c7f0 tx=0x7f2dcc00ccb0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de2062640 1 -- 172.21.15.38:0/1258737173 reap_dead start 2023-06-23T18:50:43.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 shutdown_connections 2023-06-23T18:50:43.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 >> 172.21.15.38:0/1258737173 conn(0x7f2ddc0c0c90 msgr2=0x7f2ddc0b9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 shutdown_connections 2023-06-23T18:50:43.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.811+0000 7f2de3ac5640 1 -- 172.21.15.38:0/1258737173 wait complete. 2023-06-23T18:50:43.836 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-06-23T18:50:43.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 Processor -- start 2023-06-23T18:50:43.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 -- start start 2023-06-23T18:50:43.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0c14b930 0x7f1a0c06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c06c9b0 0x7f1a0c070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0ba9d0 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0bc300 con 0x7f1a0c14b930 2023-06-23T18:50:43.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a11f91640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0a5570 con 0x7f1a0c06c9b0 2023-06-23T18:50:43.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0c14b930 0x7f1a0c06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c06c9b0 0x7f1a0c070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0c14b930 0x7f1a0c06c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:42850/0 (socket says 172.21.15.38:42850) 2023-06-23T18:50:43.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 -- 172.21.15.38:0/930735151 learned_addr learned my addr 172.21.15.38:0/930735151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 -- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c06c9b0 msgr2=0x7f1a0c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 --2- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c06c9b0 0x7f1a0c070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 -- 172.21.15.38:0/930735151 >> v1:172.21.15.81:6789/0 conn(0x7f1a0c0bd1e0 legacy=0x7f1a0c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.943+0000 7f1a0b7fe640 1 -- 172.21.15.38:0/930735151 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c150160 con 0x7f1a0c14b930 2023-06-23T18:50:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a0b7fe640 1 --2- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c14b930 0x7f1a0c06c470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=779fea0be8ff8e6b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a0a7fc640 1 -- 172.21.15.38:0/930735151 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aa430 con 0x7f1a0c14b930 2023-06-23T18:50:43.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a0a7fc640 1 -- 172.21.15.38:0/930735151 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0aa590 con 0x7f1a0c14b930 2023-06-23T18:50:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a0a7fc640 1 -- 172.21.15.38:0/930735151 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aa920 con 0x7f1a0c14b930 2023-06-23T18:50:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c14b930 msgr2=0x7f1a0c06c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c14b930 0x7f1a0c06c470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c4b0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- 172.21.15.38:0/930735151 shutdown_connections 2023-06-23T18:50:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c06c9b0 0x7f1a0c070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- 172.21.15.38:0/930735151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c14b930 0x7f1a0c06c470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- 172.21.15.38:0/930735151 >> 172.21.15.38:0/930735151 conn(0x7f1a0c0c0c90 msgr2=0x7f1a0c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:43.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- 172.21.15.38:0/930735151 shutdown_connections 2023-06-23T18:50:43.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- 172.21.15.38:0/930735151 wait complete. 2023-06-23T18:50:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 Processor -- start 2023-06-23T18:50:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- start start 2023-06-23T18:50:43.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c06c9b0 0x7f1a0c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 0x7f1a0c1e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c06ff70 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c14d720 con 0x7f1a0c06c9b0 2023-06-23T18:50:43.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.947+0000 7f1a11f91640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c14da00 con 0x7f1a0c14b930 2023-06-23T18:50:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37618/0 (socket says 172.21.15.38:37618) 2023-06-23T18:50:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 -- 172.21.15.38:0/2873202895 learned_addr learned my addr 172.21.15.38:0/2873202895 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0b7fe640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c06c9b0 0x7f1a0c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0bfff640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 0x7f1a0c1e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 -- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 msgr2=0x7f1a0c1e6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 0x7f1a0c1e6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 -- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c06c9b0 msgr2=0x7f1a0c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:43.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c06c9b0 0x7f1a0c06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 -- 172.21.15.38:0/2873202895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094d0 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0bfff640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 0x7f1a0c1e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:50:43.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0affd640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c420 tx=0x7f19f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40052d0 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4005430 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c1ea740 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4007260 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c1ea0d0 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c14dc40 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19f40073c0 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19f4083420 con 0x7f1a0c0bd1e0 2023-06-23T18:50:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.951+0000 7f1a0b7fe640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:43.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.955+0000 7f1a0b7fe640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 0x7f19ec068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:43.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:43.959+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a0c14dc40 con 0x7f1a0c0bd1e0 2023-06-23T18:50:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.111+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a0c070eb0 con 0x7f19ec066280 2023-06-23T18:50:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.111+0000 7f1a03fff640 1 -- 172.21.15.38:0/2873202895 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19fc0aa800 con 0x7f19ec066280 2023-06-23T18:50:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 7 to deep-scrub 2023-06-23T18:50:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 msgr2=0x7f19ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 0x7f19ec068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0b5040 comp rx=0 tx=0).stop 2023-06-23T18:50:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 msgr2=0x7f1a0c1e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c420 tx=0x7f19f400c8e0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 shutdown_connections 2023-06-23T18:50:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f19ec066280 0x7f19ec068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a0c14b930 0x7f1a0c1e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a0c0bd1e0 0x7f1a0c1e9b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 --2- 172.21.15.38:0/2873202895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0c06c9b0 0x7f1a0c06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 >> 172.21.15.38:0/2873202895 conn(0x7f1a0c0c0c90 msgr2=0x7f1a0c147860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 shutdown_connections 2023-06-23T18:50:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.115+0000 7f1a11f91640 1 -- 172.21.15.38:0/2873202895 wait complete. 2023-06-23T18:50:44.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:50:44.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 Processor -- start 2023-06-23T18:50:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 -- start start 2023-06-23T18:50:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd9806c6d0 0x7fbd980b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd98071290 0x7fbd980b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd980bd410 con 0x7fbd9806a630 2023-06-23T18:50:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd980a53a0 con 0x7fbd9806c6d0 2023-06-23T18:50:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9e266640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98151a00 con 0x7fbd98071290 2023-06-23T18:50:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd977fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd98071290 0x7fbd980b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd9806c6d0 0x7fbd980b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd9806c6d0 0x7fbd980b93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:42868/0 (socket says 172.21.15.38:42868) 2023-06-23T18:50:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd9c803640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd9806a630 0x7fbd9814d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:37336/0 (socket says 172.21.15.38:37336) 2023-06-23T18:50:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 -- 172.21.15.38:0/616334829 learned_addr learned my addr 172.21.15.38:0/616334829 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 -- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd98071290 msgr2=0x7fbd980b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:50:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 --2- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd98071290 0x7fbd980b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 -- 172.21.15.38:0/616334829 >> v1:172.21.15.81:6789/0 conn(0x7fbd9806a630 legacy=0x7fbd9814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.259+0000 7fbd97fff640 1 -- 172.21.15.38:0/616334829 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9806a310 con 0x7fbd9806c6d0 2023-06-23T18:50:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd97fff640 1 --2- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd9806c6d0 0x7fbd980b93e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009870 tx=0x7fbd8801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be83af2674d8d10 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd96ffd640 1 -- 172.21.15.38:0/616334829 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880ab600 con 0x7fbd9806c6d0 2023-06-23T18:50:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd96ffd640 1 -- 172.21.15.38:0/616334829 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880a7050 con 0x7fbd9806c6d0 2023-06-23T18:50:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd96ffd640 1 -- 172.21.15.38:0/616334829 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880ab980 con 0x7fbd9806c6d0 2023-06-23T18:50:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd9806c6d0 msgr2=0x7fbd980b93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 --2- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd9806c6d0 0x7fbd980b93e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009870 tx=0x7fbd8801c540 comp rx=0 tx=0).stop 2023-06-23T18:50:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- 172.21.15.38:0/616334829 shutdown_connections 2023-06-23T18:50:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 --2- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd98071290 0x7fbd980b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 --2- 172.21.15.38:0/616334829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd9806c6d0 0x7fbd980b93e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- 172.21.15.38:0/616334829 >> 172.21.15.38:0/616334829 conn(0x7fbd980c0c90 msgr2=0x7fbd980bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- 172.21.15.38:0/616334829 shutdown_connections 2023-06-23T18:50:44.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- 172.21.15.38:0/616334829 wait complete. 2023-06-23T18:50:44.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 Processor -- start 2023-06-23T18:50:44.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.263+0000 7fbd9e266640 1 -- start start 2023-06-23T18:50:44.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd9806c6d0 0x7fbd980bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd98071290 0x7fbd981e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd981e7370 con 0x7fbd9806a630 2023-06-23T18:50:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980be070 con 0x7fbd98071290 2023-06-23T18:50:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9814fa10 con 0x7fbd9806c6d0 2023-06-23T18:50:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37626/0 (socket says 172.21.15.38:37626) 2023-06-23T18:50:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 -- 172.21.15.38:0/41832500 learned_addr learned my addr 172.21.15.38:0/41832500 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:50:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd977fe640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd9806c6d0 0x7fbd980bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9c803640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd98071290 0x7fbd981e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 -- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd9806c6d0 msgr2=0x7fbd980bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd9806c6d0 0x7fbd980bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 -- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd98071290 msgr2=0x7fbd981e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd98071290 0x7fbd981e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 -- 172.21.15.38:0/41832500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd880094d0 con 0x7fbd9806a630 2023-06-23T18:50:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd97fff640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801abf0 tx=0x7fbd880192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880b6440 con 0x7fbd9806a630 2023-06-23T18:50:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd880b65c0 con 0x7fbd9806a630 2023-06-23T18:50:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd880b6970 con 0x7fbd9806a630 2023-06-23T18:50:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd981e6f90 con 0x7fbd9806a630 2023-06-23T18:50:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd98141360 con 0x7fbd9806a630 2023-06-23T18:50:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9804d790 con 0x7fbd9806a630 2023-06-23T18:50:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd880b2040 con 0x7fbd9806a630 2023-06-23T18:50:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 0x7fbd84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:50:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd8811ddf0 con 0x7fbd9806a630 2023-06-23T18:50:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.267+0000 7fbd977fe640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 0x7fbd84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:50:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.271+0000 7fbd977fe640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 0x7fbd84068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd980a5370 tx=0x7fbd8c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:50:44.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.271+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd880eaff0 con 0x7fbd9806a630 2023-06-23T18:50:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.419+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd981415b0 con 0x7fbd84066280 2023-06-23T18:50:44.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.451+0000 7fbd94ff9640 1 -- 172.21.15.38:0/41832500 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390651 (secure 0 0 0) 0x7fbd8c00f050 con 0x7fbd84066280 2023-06-23T18:50:44.462 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:50:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:50:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 msgr2=0x7fbd84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 0x7fbd84068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd980a5370 tx=0x7fbd8c00b040 comp rx=0 tx=0).stop 2023-06-23T18:50:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 msgr2=0x7fbd98140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:50:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbd8801abf0 tx=0x7fbd880192e0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 shutdown_connections 2023-06-23T18:50:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fbd84066280 0x7fbd84068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd98071290 0x7fbd981e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd9806c6d0 0x7fbd980bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 --2- 172.21.15.38:0/41832500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd9806a630 0x7fbd98140e20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:50:44.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 >> 172.21.15.38:0/41832500 conn(0x7fbd980c0c90 msgr2=0x7fbd9814e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:50:44.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 shutdown_connections 2023-06-23T18:50:44.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:50:44.455+0000 7fbd9e266640 1 -- 172.21.15.38:0/41832500 wait complete. 2023-06-23T18:50:44.479 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-06-23T18:50:43.275249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596702,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230408,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754744312,"statfs":{"total":773094113280,"available":772858175488,"internally_reserved":0,"allocated":2564096,"data_stored":2162460,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005334"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173507+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:41.173507+0000","last_peered":"2023-06-23T18:49:41.173507+0000","last_clean":"2023-06-23T18:49:41.173507+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:41.173507+0000","last_undegraded":"2023-06-23T18:49:41.173507+0000","last_fullsized":"2023-06-23T18:49:41.173507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:53.806657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546961+0000","last_change":"2023-06-23T18:49:36.397919+0000","last_active":"2023-06-23T18:49:41.546961+0000","last_peered":"2023-06-23T18:49:41.546961+0000","last_clean":"2023-06-23T18:49:41.546961+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:49:41.546961+0000","last_undegraded":"2023-06-23T18:49:41.546961+0000","last_fullsized":"2023-06-23T18:49:41.546961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:57.403766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549856+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549856+0000","last_peered":"2023-06-23T18:49:41.549856+0000","last_clean":"2023-06-23T18:49:41.549856+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549856+0000","last_undegraded":"2023-06-23T18:49:41.549856+0000","last_fullsized":"2023-06-23T18:49:41.549856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550316+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:41.550316+0000","last_peered":"2023-06-23T18:49:41.550316+0000","last_clean":"2023-06-23T18:49:41.550316+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:41.550316+0000","last_undegraded":"2023-06-23T18:49:41.550316+0000","last_fullsized":"2023-06-23T18:49:41.550316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:26:03.729738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547247+0000","last_change":"2023-06-23T18:49:36.386297+0000","last_active":"2023-06-23T18:49:41.547247+0000","last_peered":"2023-06-23T18:49:41.547247+0000","last_clean":"2023-06-23T18:49:41.547247+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:49:41.547247+0000","last_undegraded":"2023-06-23T18:49:41.547247+0000","last_fullsized":"2023-06-23T18:49:41.547247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:13.564904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176188+0000","last_change":"2023-06-23T18:49:36.776786+0000","last_active":"2023-06-23T18:49:41.176188+0000","last_peered":"2023-06-23T18:49:41.176188+0000","last_clean":"2023-06-23T18:49:41.176188+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:49:41.176188+0000","last_undegraded":"2023-06-23T18:49:41.176188+0000","last_fullsized":"2023-06-23T18:49:41.176188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:40:36.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550733+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:41.550733+0000","last_peered":"2023-06-23T18:49:41.550733+0000","last_clean":"2023-06-23T18:49:41.550733+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:41.550733+0000","last_undegraded":"2023-06-23T18:49:41.550733+0000","last_fullsized":"2023-06-23T18:49:41.550733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:11.886649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554287+0000","last_change":"2023-06-23T18:49:36.396455+0000","last_active":"2023-06-23T18:49:41.554287+0000","last_peered":"2023-06-23T18:49:41.554287+0000","last_clean":"2023-06-23T18:49:41.554287+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:49:41.554287+0000","last_undegraded":"2023-06-23T18:49:41.554287+0000","last_fullsized":"2023-06-23T18:49:41.554287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:01:49.773043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550202+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550202+0000","last_peered":"2023-06-23T18:49:41.550202+0000","last_clean":"2023-06-23T18:49:41.550202+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550202+0000","last_undegraded":"2023-06-23T18:49:41.550202+0000","last_fullsized":"2023-06-23T18:49:41.550202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553227+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:41.553227+0000","last_peered":"2023-06-23T18:49:41.553227+0000","last_clean":"2023-06-23T18:49:41.553227+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:41.553227+0000","last_undegraded":"2023-06-23T18:49:41.553227+0000","last_fullsized":"2023-06-23T18:49:41.553227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:25:37.760658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553417+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553417+0000","last_peered":"2023-06-23T18:49:41.553417+0000","last_clean":"2023-06-23T18:49:41.553417+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553417+0000","last_undegraded":"2023-06-23T18:49:41.553417+0000","last_fullsized":"2023-06-23T18:49:41.553417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:01:23.149113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550942+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550942+0000","last_peered":"2023-06-23T18:49:41.550942+0000","last_clean":"2023-06-23T18:49:41.550942+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550942+0000","last_undegraded":"2023-06-23T18:49:41.550942+0000","last_fullsized":"2023-06-23T18:49:41.550942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174504+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:41.174504+0000","last_peered":"2023-06-23T18:49:41.174504+0000","last_clean":"2023-06-23T18:49:41.174504+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:41.174504+0000","last_undegraded":"2023-06-23T18:49:41.174504+0000","last_fullsized":"2023-06-23T18:49:41.174504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:34.473121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175414+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175414+0000","last_peered":"2023-06-23T18:49:41.175414+0000","last_clean":"2023-06-23T18:49:41.175414+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175414+0000","last_undegraded":"2023-06-23T18:49:41.175414+0000","last_fullsized":"2023-06-23T18:49:41.175414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:27:45.116980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176470+0000","last_change":"2023-06-23T18:49:36.803316+0000","last_active":"2023-06-23T18:49:41.176470+0000","last_peered":"2023-06-23T18:49:41.176470+0000","last_clean":"2023-06-23T18:49:41.176470+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:49:41.176470+0000","last_undegraded":"2023-06-23T18:49:41.176470+0000","last_fullsized":"2023-06-23T18:49:41.176470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:39:33.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551013+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:41.551013+0000","last_peered":"2023-06-23T18:49:41.551013+0000","last_clean":"2023-06-23T18:49:41.551013+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:41.551013+0000","last_undegraded":"2023-06-23T18:49:41.551013+0000","last_fullsized":"2023-06-23T18:49:41.551013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:45.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:31:05.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177855+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177855+0000","last_peered":"2023-06-23T18:49:41.177855+0000","last_clean":"2023-06-23T18:49:41.177855+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177855+0000","last_undegraded":"2023-06-23T18:49:41.177855+0000","last_fullsized":"2023-06-23T18:49:41.177855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551065+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:41.551065+0000","last_peered":"2023-06-23T18:49:41.551065+0000","last_clean":"2023-06-23T18:49:41.551065+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:41.551065+0000","last_undegraded":"2023-06-23T18:49:41.551065+0000","last_fullsized":"2023-06-23T18:49:41.551065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:58.963870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174779+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.174779+0000","last_peered":"2023-06-23T18:49:41.174779+0000","last_clean":"2023-06-23T18:49:41.174779+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.174779+0000","last_undegraded":"2023-06-23T18:49:41.174779+0000","last_fullsized":"2023-06-23T18:49:41.174779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:23:37.445784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175166+0000","last_change":"2023-06-23T18:49:36.803865+0000","last_active":"2023-06-23T18:49:41.175166+0000","last_peered":"2023-06-23T18:49:41.175166+0000","last_clean":"2023-06-23T18:49:41.175166+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:49:41.175166+0000","last_undegraded":"2023-06-23T18:49:41.175166+0000","last_fullsized":"2023-06-23T18:49:41.175166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:31.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548025+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:41.548025+0000","last_peered":"2023-06-23T18:49:41.548025+0000","last_clean":"2023-06-23T18:49:41.548025+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:41.548025+0000","last_undegraded":"2023-06-23T18:49:41.548025+0000","last_fullsized":"2023-06-23T18:49:41.548025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:14.123398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546258+0000","last_change":"2023-06-23T18:49:36.397169+0000","last_active":"2023-06-23T18:49:41.546258+0000","last_peered":"2023-06-23T18:49:41.546258+0000","last_clean":"2023-06-23T18:49:41.546258+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:49:41.546258+0000","last_undegraded":"2023-06-23T18:49:41.546258+0000","last_fullsized":"2023-06-23T18:49:41.546258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:12:18.101988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554724+0000","last_change":"2023-06-23T18:49:36.780012+0000","last_active":"2023-06-23T18:49:41.554724+0000","last_peered":"2023-06-23T18:49:41.554724+0000","last_clean":"2023-06-23T18:49:41.554724+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:49:41.554724+0000","last_undegraded":"2023-06-23T18:49:41.554724+0000","last_fullsized":"2023-06-23T18:49:41.554724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:07:44.889493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175859+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175859+0000","last_peered":"2023-06-23T18:49:41.175859+0000","last_clean":"2023-06-23T18:49:41.175859+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175859+0000","last_undegraded":"2023-06-23T18:49:41.175859+0000","last_fullsized":"2023-06-23T18:49:41.175859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:03:42.222740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548413+0000","last_change":"2023-06-23T18:49:36.393800+0000","last_active":"2023-06-23T18:49:41.548413+0000","last_peered":"2023-06-23T18:49:41.548413+0000","last_clean":"2023-06-23T18:49:41.548413+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:49:41.548413+0000","last_undegraded":"2023-06-23T18:49:41.548413+0000","last_fullsized":"2023-06-23T18:49:41.548413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:18.286905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549414+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:41.549414+0000","last_peered":"2023-06-23T18:49:41.549414+0000","last_clean":"2023-06-23T18:49:41.549414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:41.549414+0000","last_undegraded":"2023-06-23T18:49:41.549414+0000","last_fullsized":"2023-06-23T18:49:41.549414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:22:13.336057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173798+0000","last_change":"2023-06-23T18:49:36.802955+0000","last_active":"2023-06-23T18:49:41.173798+0000","last_peered":"2023-06-23T18:49:41.173798+0000","last_clean":"2023-06-23T18:49:41.173798+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:49:41.173798+0000","last_undegraded":"2023-06-23T18:49:41.173798+0000","last_fullsized":"2023-06-23T18:49:41.173798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:57:55.855122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551501+0000","last_change":"2023-06-23T18:49:36.395639+0000","last_active":"2023-06-23T18:49:41.551501+0000","last_peered":"2023-06-23T18:49:41.551501+0000","last_clean":"2023-06-23T18:49:41.551501+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:49:41.551501+0000","last_undegraded":"2023-06-23T18:49:41.551501+0000","last_fullsized":"2023-06-23T18:49:41.551501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:34.255229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549419+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:41.549419+0000","last_peered":"2023-06-23T18:49:41.549419+0000","last_clean":"2023-06-23T18:49:41.549419+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:41.549419+0000","last_undegraded":"2023-06-23T18:49:41.549419+0000","last_fullsized":"2023-06-23T18:49:41.549419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176030+0000","last_change":"2023-06-23T18:49:36.400719+0000","last_active":"2023-06-23T18:49:41.176030+0000","last_peered":"2023-06-23T18:49:41.176030+0000","last_clean":"2023-06-23T18:49:41.176030+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:49:41.176030+0000","last_undegraded":"2023-06-23T18:49:41.176030+0000","last_fullsized":"2023-06-23T18:49:41.176030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:51.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174413+0000","last_change":"2023-06-23T18:49:36.797895+0000","last_active":"2023-06-23T18:49:41.174413+0000","last_peered":"2023-06-23T18:49:41.174413+0000","last_clean":"2023-06-23T18:49:41.174413+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:49:41.174413+0000","last_undegraded":"2023-06-23T18:49:41.174413+0000","last_fullsized":"2023-06-23T18:49:41.174413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:54:06.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174244+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:41.174244+0000","last_peered":"2023-06-23T18:49:41.174244+0000","last_clean":"2023-06-23T18:49:41.174244+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:41.174244+0000","last_undegraded":"2023-06-23T18:49:41.174244+0000","last_fullsized":"2023-06-23T18:49:41.174244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:55:16.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'18","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:37.121173+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:50:37.121173+0000","last_peered":"2023-06-23T18:50:37.121173+0000","last_clean":"2023-06-23T18:50:37.121173+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:50:37.121173+0000","last_undegraded":"2023-06-23T18:50:37.121173+0000","last_fullsized":"2023-06-23T18:50:37.121173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:11.122236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551092+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551092+0000","last_peered":"2023-06-23T18:49:41.551092+0000","last_clean":"2023-06-23T18:49:41.551092+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551092+0000","last_undegraded":"2023-06-23T18:49:41.551092+0000","last_fullsized":"2023-06-23T18:49:41.551092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:30.254176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545419+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:41.545419+0000","last_peered":"2023-06-23T18:49:41.545419+0000","last_clean":"2023-06-23T18:49:41.545419+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:41.545419+0000","last_undegraded":"2023-06-23T18:49:41.545419+0000","last_fullsized":"2023-06-23T18:49:41.545419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550150+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550150+0000","last_peered":"2023-06-23T18:49:41.550150+0000","last_clean":"2023-06-23T18:49:41.550150+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550150+0000","last_undegraded":"2023-06-23T18:49:41.550150+0000","last_fullsized":"2023-06-23T18:49:41.550150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:37.876660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554913+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.554913+0000","last_peered":"2023-06-23T18:49:41.554913+0000","last_clean":"2023-06-23T18:49:41.554913+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.554913+0000","last_undegraded":"2023-06-23T18:49:41.554913+0000","last_fullsized":"2023-06-23T18:49:41.554913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:10:45.110311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175369+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175369+0000","last_peered":"2023-06-23T18:49:41.175369+0000","last_clean":"2023-06-23T18:49:41.175369+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175369+0000","last_undegraded":"2023-06-23T18:49:41.175369+0000","last_fullsized":"2023-06-23T18:49:41.175369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:37.906492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175308+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:41.175308+0000","last_peered":"2023-06-23T18:49:41.175308+0000","last_clean":"2023-06-23T18:49:41.175308+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:41.175308+0000","last_undegraded":"2023-06-23T18:49:41.175308+0000","last_fullsized":"2023-06-23T18:49:41.175308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:03:57.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173565+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173565+0000","last_peered":"2023-06-23T18:49:41.173565+0000","last_clean":"2023-06-23T18:49:41.173565+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173565+0000","last_undegraded":"2023-06-23T18:49:41.173565+0000","last_fullsized":"2023-06-23T18:49:41.173565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:16.980080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176097+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176097+0000","last_peered":"2023-06-23T18:49:41.176097+0000","last_clean":"2023-06-23T18:49:41.176097+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176097+0000","last_undegraded":"2023-06-23T18:49:41.176097+0000","last_fullsized":"2023-06-23T18:49:41.176097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:31.399937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176123+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176123+0000","last_peered":"2023-06-23T18:49:41.176123+0000","last_clean":"2023-06-23T18:49:41.176123+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176123+0000","last_undegraded":"2023-06-23T18:49:41.176123+0000","last_fullsized":"2023-06-23T18:49:41.176123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:40:53.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549551+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:41.549551+0000","last_peered":"2023-06-23T18:49:41.549551+0000","last_clean":"2023-06-23T18:49:41.549551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:41.549551+0000","last_undegraded":"2023-06-23T18:49:41.549551+0000","last_fullsized":"2023-06-23T18:49:41.549551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:09:18.124574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547371+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547371+0000","last_peered":"2023-06-23T18:49:41.547371+0000","last_clean":"2023-06-23T18:49:41.547371+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547371+0000","last_undegraded":"2023-06-23T18:49:41.547371+0000","last_fullsized":"2023-06-23T18:49:41.547371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554659+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554659+0000","last_peered":"2023-06-23T18:49:41.554659+0000","last_clean":"2023-06-23T18:49:41.554659+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554659+0000","last_undegraded":"2023-06-23T18:49:41.554659+0000","last_fullsized":"2023-06-23T18:49:41.554659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:22.160158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548567+0000","last_change":"2023-06-23T18:49:36.401310+0000","last_active":"2023-06-23T18:49:41.548567+0000","last_peered":"2023-06-23T18:49:41.548567+0000","last_clean":"2023-06-23T18:49:41.548567+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:49:41.548567+0000","last_undegraded":"2023-06-23T18:49:41.548567+0000","last_fullsized":"2023-06-23T18:49:41.548567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:54.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176277+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:41.176277+0000","last_peered":"2023-06-23T18:49:41.176277+0000","last_clean":"2023-06-23T18:49:41.176277+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:41.176277+0000","last_undegraded":"2023-06-23T18:49:41.176277+0000","last_fullsized":"2023-06-23T18:49:41.176277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546001+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546001+0000","last_peered":"2023-06-23T18:49:41.546001+0000","last_clean":"2023-06-23T18:49:41.546001+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546001+0000","last_undegraded":"2023-06-23T18:49:41.546001+0000","last_fullsized":"2023-06-23T18:49:41.546001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547284+0000","last_change":"2023-06-23T18:49:32.676689+0000","last_active":"2023-06-23T18:49:41.547284+0000","last_peered":"2023-06-23T18:49:41.547284+0000","last_clean":"2023-06-23T18:49:41.547284+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:49:41.547284+0000","last_undegraded":"2023-06-23T18:49:41.547284+0000","last_fullsized":"2023-06-23T18:49:41.547284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:54:15.766485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550819+0000","last_change":"2023-06-23T18:49:36.401220+0000","last_active":"2023-06-23T18:49:41.550819+0000","last_peered":"2023-06-23T18:49:41.550819+0000","last_clean":"2023-06-23T18:49:41.550819+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:49:41.550819+0000","last_undegraded":"2023-06-23T18:49:41.550819+0000","last_fullsized":"2023-06-23T18:49:41.550819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:38:09.697425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174641+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:41.174641+0000","last_peered":"2023-06-23T18:49:41.174641+0000","last_clean":"2023-06-23T18:49:41.174641+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:41.174641+0000","last_undegraded":"2023-06-23T18:49:41.174641+0000","last_fullsized":"2023-06-23T18:49:41.174641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:47:58.438859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548051+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548051+0000","last_peered":"2023-06-23T18:49:41.548051+0000","last_clean":"2023-06-23T18:49:41.548051+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548051+0000","last_undegraded":"2023-06-23T18:49:41.548051+0000","last_fullsized":"2023-06-23T18:49:41.548051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:19:18.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175781+0000","last_change":"2023-06-23T18:49:36.389975+0000","last_active":"2023-06-23T18:49:41.175781+0000","last_peered":"2023-06-23T18:49:41.175781+0000","last_clean":"2023-06-23T18:49:41.175781+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:49:41.175781+0000","last_undegraded":"2023-06-23T18:49:41.175781+0000","last_fullsized":"2023-06-23T18:49:41.175781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554264+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554264+0000","last_peered":"2023-06-23T18:49:41.554264+0000","last_clean":"2023-06-23T18:49:41.554264+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554264+0000","last_undegraded":"2023-06-23T18:49:41.554264+0000","last_fullsized":"2023-06-23T18:49:41.554264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:40:47.271580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177713+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:41.177713+0000","last_peered":"2023-06-23T18:49:41.177713+0000","last_clean":"2023-06-23T18:49:41.177713+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:41.177713+0000","last_undegraded":"2023-06-23T18:49:41.177713+0000","last_fullsized":"2023-06-23T18:49:41.177713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:41.289480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548159+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548159+0000","last_peered":"2023-06-23T18:49:41.548159+0000","last_clean":"2023-06-23T18:49:41.548159+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548159+0000","last_undegraded":"2023-06-23T18:49:41.548159+0000","last_fullsized":"2023-06-23T18:49:41.548159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:14:41.812465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545781+0000","last_change":"2023-06-23T18:49:36.385871+0000","last_active":"2023-06-23T18:49:41.545781+0000","last_peered":"2023-06-23T18:49:41.545781+0000","last_clean":"2023-06-23T18:49:41.545781+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:49:41.545781+0000","last_undegraded":"2023-06-23T18:49:41.545781+0000","last_fullsized":"2023-06-23T18:49:41.545781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:11:46.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176403+0000","last_change":"2023-06-23T18:49:32.328052+0000","last_active":"2023-06-23T18:49:41.176403+0000","last_peered":"2023-06-23T18:49:41.176403+0000","last_clean":"2023-06-23T18:49:41.176403+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:49:41.176403+0000","last_undegraded":"2023-06-23T18:49:41.176403+0000","last_fullsized":"2023-06-23T18:49:41.176403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:02.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177308+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:41.177308+0000","last_peered":"2023-06-23T18:49:41.177308+0000","last_clean":"2023-06-23T18:49:41.177308+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:41.177308+0000","last_undegraded":"2023-06-23T18:49:41.177308+0000","last_fullsized":"2023-06-23T18:49:41.177308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:51.002280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546979+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.546979+0000","last_peered":"2023-06-23T18:49:41.546979+0000","last_clean":"2023-06-23T18:49:41.546979+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.546979+0000","last_undegraded":"2023-06-23T18:49:41.546979+0000","last_fullsized":"2023-06-23T18:49:41.546979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:06:55.846114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547213+0000","last_change":"2023-06-23T18:49:36.395411+0000","last_active":"2023-06-23T18:49:41.547213+0000","last_peered":"2023-06-23T18:49:41.547213+0000","last_clean":"2023-06-23T18:49:41.547213+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:49:41.547213+0000","last_undegraded":"2023-06-23T18:49:41.547213+0000","last_fullsized":"2023-06-23T18:49:41.547213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:06.809147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549313+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549313+0000","last_peered":"2023-06-23T18:49:41.549313+0000","last_clean":"2023-06-23T18:49:41.549313+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549313+0000","last_undegraded":"2023-06-23T18:49:41.549313+0000","last_fullsized":"2023-06-23T18:49:41.549313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:20:46.575342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554699+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:41.554699+0000","last_peered":"2023-06-23T18:49:41.554699+0000","last_clean":"2023-06-23T18:49:41.554699+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:41.554699+0000","last_undegraded":"2023-06-23T18:49:41.554699+0000","last_fullsized":"2023-06-23T18:49:41.554699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:57:28.117389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554431+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554431+0000","last_peered":"2023-06-23T18:49:41.554431+0000","last_clean":"2023-06-23T18:49:41.554431+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554431+0000","last_undegraded":"2023-06-23T18:49:41.554431+0000","last_fullsized":"2023-06-23T18:49:41.554431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:54:18.686547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174475+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174475+0000","last_peered":"2023-06-23T18:49:41.174475+0000","last_clean":"2023-06-23T18:49:41.174475+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174475+0000","last_undegraded":"2023-06-23T18:49:41.174475+0000","last_fullsized":"2023-06-23T18:49:41.174475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:50:33.419540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553014+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553014+0000","last_peered":"2023-06-23T18:49:41.553014+0000","last_clean":"2023-06-23T18:49:41.553014+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553014+0000","last_undegraded":"2023-06-23T18:49:41.553014+0000","last_fullsized":"2023-06-23T18:49:41.553014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:12:49.382417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551721+0000","last_change":"2023-06-23T18:49:24.782884+0000","last_active":"2023-06-23T18:49:41.551721+0000","last_peered":"2023-06-23T18:49:41.551721+0000","last_clean":"2023-06-23T18:49:41.551721+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:49:41.551721+0000","last_undegraded":"2023-06-23T18:49:41.551721+0000","last_fullsized":"2023-06-23T18:49:41.551721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:23.322678+0000","last_clean_scrub_stamp":"2023-06-23T18:49:23.322678+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:11:08.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175707+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:41.175707+0000","last_peered":"2023-06-23T18:49:41.175707+0000","last_clean":"2023-06-23T18:49:41.175707+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:41.175707+0000","last_undegraded":"2023-06-23T18:49:41.175707+0000","last_fullsized":"2023-06-23T18:49:41.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:33:10.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177440+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177440+0000","last_peered":"2023-06-23T18:49:41.177440+0000","last_clean":"2023-06-23T18:49:41.177440+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177440+0000","last_undegraded":"2023-06-23T18:49:41.177440+0000","last_fullsized":"2023-06-23T18:49:41.177440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:52.410271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173907+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.173907+0000","last_peered":"2023-06-23T18:49:41.173907+0000","last_clean":"2023-06-23T18:49:41.173907+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.173907+0000","last_undegraded":"2023-06-23T18:49:41.173907+0000","last_fullsized":"2023-06-23T18:49:41.173907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:31.129946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554978+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:41.554978+0000","last_peered":"2023-06-23T18:49:41.554978+0000","last_clean":"2023-06-23T18:49:41.554978+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:41.554978+0000","last_undegraded":"2023-06-23T18:49:41.554978+0000","last_fullsized":"2023-06-23T18:49:41.554978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:18:13.689741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551177+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551177+0000","last_peered":"2023-06-23T18:49:41.551177+0000","last_clean":"2023-06-23T18:49:41.551177+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551177+0000","last_undegraded":"2023-06-23T18:49:41.551177+0000","last_fullsized":"2023-06-23T18:49:41.551177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:46:53.836451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552185+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552185+0000","last_peered":"2023-06-23T18:49:41.552185+0000","last_clean":"2023-06-23T18:49:41.552185+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552185+0000","last_undegraded":"2023-06-23T18:49:41.552185+0000","last_fullsized":"2023-06-23T18:49:41.552185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:35:31.063774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553794+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:41.553794+0000","last_peered":"2023-06-23T18:49:41.553794+0000","last_clean":"2023-06-23T18:49:41.553794+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:41.553794+0000","last_undegraded":"2023-06-23T18:49:41.553794+0000","last_fullsized":"2023-06-23T18:49:41.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:57:54.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553472+0000","last_change":"2023-06-23T18:49:36.772762+0000","last_active":"2023-06-23T18:49:41.553472+0000","last_peered":"2023-06-23T18:49:41.553472+0000","last_clean":"2023-06-23T18:49:41.553472+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:49:41.553472+0000","last_undegraded":"2023-06-23T18:49:41.553472+0000","last_fullsized":"2023-06-23T18:49:41.553472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:33:21.229453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553936+0000","last_change":"2023-06-23T18:49:36.394215+0000","last_active":"2023-06-23T18:49:41.553936+0000","last_peered":"2023-06-23T18:49:41.553936+0000","last_clean":"2023-06-23T18:49:41.553936+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:49:41.553936+0000","last_undegraded":"2023-06-23T18:49:41.553936+0000","last_fullsized":"2023-06-23T18:49:41.553936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:21:31.409470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546296+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:41.546296+0000","last_peered":"2023-06-23T18:49:41.546296+0000","last_clean":"2023-06-23T18:49:41.546296+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:41.546296+0000","last_undegraded":"2023-06-23T18:49:41.546296+0000","last_fullsized":"2023-06-23T18:49:41.546296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:36:16.929824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176023+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176023+0000","last_peered":"2023-06-23T18:49:41.176023+0000","last_clean":"2023-06-23T18:49:41.176023+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176023+0000","last_undegraded":"2023-06-23T18:49:41.176023+0000","last_fullsized":"2023-06-23T18:49:41.176023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176830+0000","last_change":"2023-06-23T18:49:36.393160+0000","last_active":"2023-06-23T18:49:41.176830+0000","last_peered":"2023-06-23T18:49:41.176830+0000","last_clean":"2023-06-23T18:49:41.176830+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:49:41.176830+0000","last_undegraded":"2023-06-23T18:49:41.176830+0000","last_fullsized":"2023-06-23T18:49:41.176830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:08.808285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176958+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:41.176958+0000","last_peered":"2023-06-23T18:49:41.176958+0000","last_clean":"2023-06-23T18:49:41.176958+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:41.176958+0000","last_undegraded":"2023-06-23T18:49:41.176958+0000","last_fullsized":"2023-06-23T18:49:41.176958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:56.469802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547869+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547869+0000","last_peered":"2023-06-23T18:49:41.547869+0000","last_clean":"2023-06-23T18:49:41.547869+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547869+0000","last_undegraded":"2023-06-23T18:49:41.547869+0000","last_fullsized":"2023-06-23T18:49:41.547869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:35:12.874805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176090+0000","last_change":"2023-06-23T18:49:36.392433+0000","last_active":"2023-06-23T18:49:41.176090+0000","last_peered":"2023-06-23T18:49:41.176090+0000","last_clean":"2023-06-23T18:49:41.176090+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:49:41.176090+0000","last_undegraded":"2023-06-23T18:49:41.176090+0000","last_fullsized":"2023-06-23T18:49:41.176090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:21.869159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545792+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:41.545792+0000","last_peered":"2023-06-23T18:49:41.545792+0000","last_clean":"2023-06-23T18:49:41.545792+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:41.545792+0000","last_undegraded":"2023-06-23T18:49:41.545792+0000","last_fullsized":"2023-06-23T18:49:41.545792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:55.823091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550522+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550522+0000","last_peered":"2023-06-23T18:49:41.550522+0000","last_clean":"2023-06-23T18:49:41.550522+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550522+0000","last_undegraded":"2023-06-23T18:49:41.550522+0000","last_fullsized":"2023-06-23T18:49:41.550522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554481+0000","last_change":"2023-06-23T18:49:36.394405+0000","last_active":"2023-06-23T18:49:41.554481+0000","last_peered":"2023-06-23T18:49:41.554481+0000","last_clean":"2023-06-23T18:49:41.554481+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:49:41.554481+0000","last_undegraded":"2023-06-23T18:49:41.554481+0000","last_fullsized":"2023-06-23T18:49:41.554481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:43:25.261298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547467+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:41.547467+0000","last_peered":"2023-06-23T18:49:41.547467+0000","last_clean":"2023-06-23T18:49:41.547467+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:41.547467+0000","last_undegraded":"2023-06-23T18:49:41.547467+0000","last_fullsized":"2023-06-23T18:49:41.547467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:19:56.740188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552282+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552282+0000","last_peered":"2023-06-23T18:49:41.552282+0000","last_clean":"2023-06-23T18:49:41.552282+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552282+0000","last_undegraded":"2023-06-23T18:49:41.552282+0000","last_fullsized":"2023-06-23T18:49:41.552282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:12:50.078368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551890+0000","last_change":"2023-06-23T18:49:36.396315+0000","last_active":"2023-06-23T18:49:41.551890+0000","last_peered":"2023-06-23T18:49:41.551890+0000","last_clean":"2023-06-23T18:49:41.551890+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:49:41.551890+0000","last_undegraded":"2023-06-23T18:49:41.551890+0000","last_fullsized":"2023-06-23T18:49:41.551890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:30.930810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545080+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:41.545080+0000","last_peered":"2023-06-23T18:49:41.545080+0000","last_clean":"2023-06-23T18:49:41.545080+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:41.545080+0000","last_undegraded":"2023-06-23T18:49:41.545080+0000","last_fullsized":"2023-06-23T18:49:41.545080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:13.234258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549130+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549130+0000","last_peered":"2023-06-23T18:49:41.549130+0000","last_clean":"2023-06-23T18:49:41.549130+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549130+0000","last_undegraded":"2023-06-23T18:49:41.549130+0000","last_fullsized":"2023-06-23T18:49:41.549130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:24:27.601005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176921+0000","last_change":"2023-06-23T18:49:36.390966+0000","last_active":"2023-06-23T18:49:41.176921+0000","last_peered":"2023-06-23T18:49:41.176921+0000","last_clean":"2023-06-23T18:49:41.176921+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:49:41.176921+0000","last_undegraded":"2023-06-23T18:49:41.176921+0000","last_fullsized":"2023-06-23T18:49:41.176921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:07.460676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:17:04.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554482+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:41.554482+0000","last_peered":"2023-06-23T18:49:41.554482+0000","last_clean":"2023-06-23T18:49:41.554482+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:41.554482+0000","last_undegraded":"2023-06-23T18:49:41.554482+0000","last_fullsized":"2023-06-23T18:49:41.554482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:48:03.724365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551195+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551195+0000","last_peered":"2023-06-23T18:49:41.551195+0000","last_clean":"2023-06-23T18:49:41.551195+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551195+0000","last_undegraded":"2023-06-23T18:49:41.551195+0000","last_fullsized":"2023-06-23T18:49:41.551195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.374085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546758+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546758+0000","last_peered":"2023-06-23T18:49:41.546758+0000","last_clean":"2023-06-23T18:49:41.546758+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546758+0000","last_undegraded":"2023-06-23T18:49:41.546758+0000","last_fullsized":"2023-06-23T18:49:41.546758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:53:17.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174173+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:41.174173+0000","last_peered":"2023-06-23T18:49:41.174173+0000","last_clean":"2023-06-23T18:49:41.174173+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:41.174173+0000","last_undegraded":"2023-06-23T18:49:41.174173+0000","last_fullsized":"2023-06-23T18:49:41.174173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:14.295896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552083+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552083+0000","last_peered":"2023-06-23T18:49:41.552083+0000","last_clean":"2023-06-23T18:49:41.552083+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552083+0000","last_undegraded":"2023-06-23T18:49:41.552083+0000","last_fullsized":"2023-06-23T18:49:41.552083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:56:11.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546735+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546735+0000","last_peered":"2023-06-23T18:49:41.546735+0000","last_clean":"2023-06-23T18:49:41.546735+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546735+0000","last_undegraded":"2023-06-23T18:49:41.546735+0000","last_fullsized":"2023-06-23T18:49:41.546735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:04.679590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546468+0000","last_change":"2023-06-23T18:49:36.390861+0000","last_active":"2023-06-23T18:49:41.546468+0000","last_peered":"2023-06-23T18:49:41.546468+0000","last_clean":"2023-06-23T18:49:41.546468+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:49:41.546468+0000","last_undegraded":"2023-06-23T18:49:41.546468+0000","last_fullsized":"2023-06-23T18:49:41.546468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:36.863507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554251+0000","last_change":"2023-06-23T18:49:36.769476+0000","last_active":"2023-06-23T18:49:41.554251+0000","last_peered":"2023-06-23T18:49:41.554251+0000","last_clean":"2023-06-23T18:49:41.554251+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:49:41.554251+0000","last_undegraded":"2023-06-23T18:49:41.554251+0000","last_fullsized":"2023-06-23T18:49:41.554251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:53:12.510569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175471+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:41.175471+0000","last_peered":"2023-06-23T18:49:41.175471+0000","last_clean":"2023-06-23T18:49:41.175471+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:41.175471+0000","last_undegraded":"2023-06-23T18:49:41.175471+0000","last_fullsized":"2023-06-23T18:49:41.175471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:34:26.874770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552882+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552882+0000","last_peered":"2023-06-23T18:49:41.552882+0000","last_clean":"2023-06-23T18:49:41.552882+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552882+0000","last_undegraded":"2023-06-23T18:49:41.552882+0000","last_fullsized":"2023-06-23T18:49:41.552882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:26:49.490247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547756+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547756+0000","last_peered":"2023-06-23T18:49:41.547756+0000","last_clean":"2023-06-23T18:49:41.547756+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547756+0000","last_undegraded":"2023-06-23T18:49:41.547756+0000","last_fullsized":"2023-06-23T18:49:41.547756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:22:08.473829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552769+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:41.552769+0000","last_peered":"2023-06-23T18:49:41.552769+0000","last_clean":"2023-06-23T18:49:41.552769+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:41.552769+0000","last_undegraded":"2023-06-23T18:49:41.552769+0000","last_fullsized":"2023-06-23T18:49:41.552769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:00.260857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550890+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550890+0000","last_peered":"2023-06-23T18:49:41.550890+0000","last_clean":"2023-06-23T18:49:41.550890+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550890+0000","last_undegraded":"2023-06-23T18:49:41.550890+0000","last_fullsized":"2023-06-23T18:49:41.550890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:06:00.997634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.544989+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.544989+0000","last_peered":"2023-06-23T18:49:41.544989+0000","last_clean":"2023-06-23T18:49:41.544989+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.544989+0000","last_undegraded":"2023-06-23T18:49:41.544989+0000","last_fullsized":"2023-06-23T18:49:41.544989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176480+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176480+0000","last_peered":"2023-06-23T18:49:41.176480+0000","last_clean":"2023-06-23T18:49:41.176480+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176480+0000","last_undegraded":"2023-06-23T18:49:41.176480+0000","last_fullsized":"2023-06-23T18:49:41.176480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:51:35.864094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547821+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547821+0000","last_peered":"2023-06-23T18:49:41.547821+0000","last_clean":"2023-06-23T18:49:41.547821+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547821+0000","last_undegraded":"2023-06-23T18:49:41.547821+0000","last_fullsized":"2023-06-23T18:49:41.547821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:05:48.032105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546977+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.546977+0000","last_peered":"2023-06-23T18:49:41.546977+0000","last_clean":"2023-06-23T18:49:41.546977+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.546977+0000","last_undegraded":"2023-06-23T18:49:41.546977+0000","last_fullsized":"2023-06-23T18:49:41.546977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:16:55.901007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554623+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554623+0000","last_peered":"2023-06-23T18:49:41.554623+0000","last_clean":"2023-06-23T18:49:41.554623+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554623+0000","last_undegraded":"2023-06-23T18:49:41.554623+0000","last_fullsized":"2023-06-23T18:49:41.554623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:54:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177548+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177548+0000","last_peered":"2023-06-23T18:49:41.177548+0000","last_clean":"2023-06-23T18:49:41.177548+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177548+0000","last_undegraded":"2023-06-23T18:49:41.177548+0000","last_fullsized":"2023-06-23T18:49:41.177548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:22.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175185+0000","last_change":"2023-06-23T18:49:36.797593+0000","last_active":"2023-06-23T18:49:41.175185+0000","last_peered":"2023-06-23T18:49:41.175185+0000","last_clean":"2023-06-23T18:49:41.175185+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:49:41.175185+0000","last_undegraded":"2023-06-23T18:49:41.175185+0000","last_fullsized":"2023-06-23T18:49:41.175185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:53.716333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550601+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550601+0000","last_peered":"2023-06-23T18:49:41.550601+0000","last_clean":"2023-06-23T18:49:41.550601+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550601+0000","last_undegraded":"2023-06-23T18:49:41.550601+0000","last_fullsized":"2023-06-23T18:49:41.550601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:59:24.044272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173484+0000","last_change":"2023-06-23T18:49:36.809174+0000","last_active":"2023-06-23T18:49:41.173484+0000","last_peered":"2023-06-23T18:49:41.173484+0000","last_clean":"2023-06-23T18:49:41.173484+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:49:41.173484+0000","last_undegraded":"2023-06-23T18:49:41.173484+0000","last_fullsized":"2023-06-23T18:49:41.173484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:12.943229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176283+0000","last_change":"2023-06-23T18:49:36.812118+0000","last_active":"2023-06-23T18:49:41.176283+0000","last_peered":"2023-06-23T18:49:41.176283+0000","last_clean":"2023-06-23T18:49:41.176283+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:49:41.176283+0000","last_undegraded":"2023-06-23T18:49:41.176283+0000","last_fullsized":"2023-06-23T18:49:41.176283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553078+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553078+0000","last_peered":"2023-06-23T18:49:41.553078+0000","last_clean":"2023-06-23T18:49:41.553078+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553078+0000","last_undegraded":"2023-06-23T18:49:41.553078+0000","last_fullsized":"2023-06-23T18:49:41.553078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:03:50.692029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553368+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553368+0000","last_peered":"2023-06-23T18:49:41.553368+0000","last_clean":"2023-06-23T18:49:41.553368+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553368+0000","last_undegraded":"2023-06-23T18:49:41.553368+0000","last_fullsized":"2023-06-23T18:49:41.553368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:14:37.412501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548158+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548158+0000","last_peered":"2023-06-23T18:49:41.548158+0000","last_clean":"2023-06-23T18:49:41.548158+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548158+0000","last_undegraded":"2023-06-23T18:49:41.548158+0000","last_fullsized":"2023-06-23T18:49:41.548158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:05:37.805597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176296+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176296+0000","last_peered":"2023-06-23T18:49:41.176296+0000","last_clean":"2023-06-23T18:49:41.176296+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176296+0000","last_undegraded":"2023-06-23T18:49:41.176296+0000","last_fullsized":"2023-06-23T18:49:41.176296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:05:07.822300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177319+0000","last_change":"2023-06-23T18:49:36.788048+0000","last_active":"2023-06-23T18:49:41.177319+0000","last_peered":"2023-06-23T18:49:41.177319+0000","last_clean":"2023-06-23T18:49:41.177319+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:49:41.177319+0000","last_undegraded":"2023-06-23T18:49:41.177319+0000","last_fullsized":"2023-06-23T18:49:41.177319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549106+0000","last_change":"2023-06-23T18:49:36.794820+0000","last_active":"2023-06-23T18:49:41.549106+0000","last_peered":"2023-06-23T18:49:41.549106+0000","last_clean":"2023-06-23T18:49:41.549106+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:49:41.549106+0000","last_undegraded":"2023-06-23T18:49:41.549106+0000","last_fullsized":"2023-06-23T18:49:41.549106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:07.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175589+0000","last_change":"2023-06-23T18:49:36.815327+0000","last_active":"2023-06-23T18:49:41.175589+0000","last_peered":"2023-06-23T18:49:41.175589+0000","last_clean":"2023-06-23T18:49:41.175589+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:49:41.175589+0000","last_undegraded":"2023-06-23T18:49:41.175589+0000","last_fullsized":"2023-06-23T18:49:41.175589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:27:34.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552495+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552495+0000","last_peered":"2023-06-23T18:49:41.552495+0000","last_clean":"2023-06-23T18:49:41.552495+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552495+0000","last_undegraded":"2023-06-23T18:49:41.552495+0000","last_fullsized":"2023-06-23T18:49:41.552495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:47:35.890473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545523+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545523+0000","last_peered":"2023-06-23T18:49:41.545523+0000","last_clean":"2023-06-23T18:49:41.545523+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545523+0000","last_undegraded":"2023-06-23T18:49:41.545523+0000","last_fullsized":"2023-06-23T18:49:41.545523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:56:28.934643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546678+0000","last_change":"2023-06-23T18:49:36.773452+0000","last_active":"2023-06-23T18:49:41.546678+0000","last_peered":"2023-06-23T18:49:41.546678+0000","last_clean":"2023-06-23T18:49:41.546678+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:49:41.546678+0000","last_undegraded":"2023-06-23T18:49:41.546678+0000","last_fullsized":"2023-06-23T18:49:41.546678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:32:13.055295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553889+0000","last_change":"2023-06-23T18:49:36.768508+0000","last_active":"2023-06-23T18:49:41.553889+0000","last_peered":"2023-06-23T18:49:41.553889+0000","last_clean":"2023-06-23T18:49:41.553889+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:49:41.553889+0000","last_undegraded":"2023-06-23T18:49:41.553889+0000","last_fullsized":"2023-06-23T18:49:41.553889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:48.650761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554200+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554200+0000","last_peered":"2023-06-23T18:49:41.554200+0000","last_clean":"2023-06-23T18:49:41.554200+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554200+0000","last_undegraded":"2023-06-23T18:49:41.554200+0000","last_fullsized":"2023-06-23T18:49:41.554200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:16.745729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175123+0000","last_change":"2023-06-23T18:49:36.798325+0000","last_active":"2023-06-23T18:49:41.175123+0000","last_peered":"2023-06-23T18:49:41.175123+0000","last_clean":"2023-06-23T18:49:41.175123+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:49:41.175123+0000","last_undegraded":"2023-06-23T18:49:41.175123+0000","last_fullsized":"2023-06-23T18:49:41.175123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:18.062097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549827+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549827+0000","last_peered":"2023-06-23T18:49:41.549827+0000","last_clean":"2023-06-23T18:49:41.549827+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549827+0000","last_undegraded":"2023-06-23T18:49:41.549827+0000","last_fullsized":"2023-06-23T18:49:41.549827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549615+0000","last_change":"2023-06-23T18:49:36.760875+0000","last_active":"2023-06-23T18:49:41.549615+0000","last_peered":"2023-06-23T18:49:41.549615+0000","last_clean":"2023-06-23T18:49:41.549615+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:49:41.549615+0000","last_undegraded":"2023-06-23T18:49:41.549615+0000","last_fullsized":"2023-06-23T18:49:41.549615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:47.069104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553434+0000","last_change":"2023-06-23T18:49:36.760828+0000","last_active":"2023-06-23T18:49:41.553434+0000","last_peered":"2023-06-23T18:49:41.553434+0000","last_clean":"2023-06-23T18:49:41.553434+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:49:41.553434+0000","last_undegraded":"2023-06-23T18:49:41.553434+0000","last_fullsized":"2023-06-23T18:49:41.553434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:24:26.942204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175118+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175118+0000","last_peered":"2023-06-23T18:49:41.175118+0000","last_clean":"2023-06-23T18:49:41.175118+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175118+0000","last_undegraded":"2023-06-23T18:49:41.175118+0000","last_fullsized":"2023-06-23T18:49:41.175118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:06:59.079147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175866+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175866+0000","last_peered":"2023-06-23T18:49:41.175866+0000","last_clean":"2023-06-23T18:49:41.175866+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175866+0000","last_undegraded":"2023-06-23T18:49:41.175866+0000","last_fullsized":"2023-06-23T18:49:41.175866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:21:53.056983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175969+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.175969+0000","last_peered":"2023-06-23T18:49:41.175969+0000","last_clean":"2023-06-23T18:49:41.175969+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.175969+0000","last_undegraded":"2023-06-23T18:49:41.175969+0000","last_fullsized":"2023-06-23T18:49:41.175969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:39:47.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554784+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554784+0000","last_peered":"2023-06-23T18:49:41.554784+0000","last_clean":"2023-06-23T18:49:41.554784+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554784+0000","last_undegraded":"2023-06-23T18:49:41.554784+0000","last_fullsized":"2023-06-23T18:49:41.554784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:44:57.443502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547179+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547179+0000","last_peered":"2023-06-23T18:49:41.547179+0000","last_clean":"2023-06-23T18:49:41.547179+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547179+0000","last_undegraded":"2023-06-23T18:49:41.547179+0000","last_fullsized":"2023-06-23T18:49:41.547179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:49:23.654622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6334,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.63}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.66400000000000003}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.877},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.997}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.872},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.002}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1439999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.034}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.089},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.109}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.70399999999999996}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.044},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.96099999999999997}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.075},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.016}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.374},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.30499999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.62},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.628}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.623}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.88200000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.028},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.056}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.624},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.746},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.014},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.83499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.224},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.0649999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.032}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.097},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.93200000000000005}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.997}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.079},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.1020000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.032},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.96999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:50:44.491 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.492 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.492 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.493 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.493 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.493 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.494 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.494 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.494 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.494 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.495 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.495 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.495 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.496 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.496 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.496 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.496 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.497 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.497 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.498 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.498 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.498 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.498 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.499 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.499 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.499 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.500 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.500 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.500 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.501 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.501 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.501 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.501 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.502 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.502 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.502 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.503 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.503 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.503 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.503 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.504 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.504 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.504 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.505 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.505 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.505 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.505 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.506 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.506 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.506 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.507 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.507 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.507 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.507 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.508 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.508 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.508 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.509 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.509 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.509 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.509 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.510 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.510 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.510 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.510 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.511 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.511 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.511 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-06-23T18:49:23.322678+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=23, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.512 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.512 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.512 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.512 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.513 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.513 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.513 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.514 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.514 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.514 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.514 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.515 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.515 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.515 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.516 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.516 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.516 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.516 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.517 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.517 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.517 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.518 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.518 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.518 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.518 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.519 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.519 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.519 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.520 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.520 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.520 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.520 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.521 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.521 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.521 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.522 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.522 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.522 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.522 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.523 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.523 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.523 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.524 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.524 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.524 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.524 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.525 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.525 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.525 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.526 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.526 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.526 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.526 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.527 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.527 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.527 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.528 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.528 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.528 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.528 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.529 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.529 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.529 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.530 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.530 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.530 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.530 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.531 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.531 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:50:44.531 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-23T18:50:53.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:53.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:53.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:53.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:53.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:04.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.655+0000 7fdf9d986640 1 Processor -- start 2023-06-23T18:51:04.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.655+0000 7fdf9d986640 1 -- start start 2023-06-23T18:51:04.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf9d986640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9814b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf9d986640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf980b4e10 0x7fdf9814b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf9d986640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980bd210 con 0x7fdf9806e7d0 2023-06-23T18:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf9d986640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980b7920 con 0x7fdf980b4e10 2023-06-23T18:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf9d986640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9814bb80 con 0x7fdf9806df50 2023-06-23T18:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf980b4e10 0x7fdf9814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf980b4e10 0x7fdf9814b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34116/0 (socket says 172.21.15.38:34116) 2023-06-23T18:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 -- 172.21.15.38:0/4082697635 learned_addr learned my addr 172.21.15.38:0/4082697635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf96ffd640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 -- 172.21.15.38:0/4082697635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 msgr2=0x7fdf9814b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9814b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 -- 172.21.15.38:0/4082697635 >> v1:172.21.15.81:6789/0 conn(0x7fdf9806e7d0 legacy=0x7fdf9814c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:51:04.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 -- 172.21.15.38:0/4082697635 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980bd4f0 con 0x7fdf980b4e10 2023-06-23T18:51:04.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf967fc640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980b4e10 0x7fdf9814b640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f68761ce8c0472 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:04.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf95ffb640 1 -- 172.21.15.38:0/4082697635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0ab670 con 0x7fdf980b4e10 2023-06-23T18:51:04.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.659+0000 7fdf95ffb640 1 -- 172.21.15.38:0/4082697635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0ab7d0 con 0x7fdf980b4e10 2023-06-23T18:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf95ffb640 1 -- 172.21.15.38:0/4082697635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0abb60 con 0x7fdf980b4e10 2023-06-23T18:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/4082697635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980b4e10 msgr2=0x7fdf9814b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980b4e10 0x7fdf9814b640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c4d0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/4082697635 shutdown_connections 2023-06-23T18:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980b4e10 0x7fdf9814b640 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- 172.21.15.38:0/4082697635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9814b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/4082697635 >> 172.21.15.38:0/4082697635 conn(0x7fdf980bfca0 msgr2=0x7fdf980c00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/4082697635 shutdown_connections 2023-06-23T18:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/4082697635 wait complete. 2023-06-23T18:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 Processor -- start 2023-06-23T18:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- start start 2023-06-23T18:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9813aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf980b4e10 0x7fdf9814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98070b60 con 0x7fdf9806e7d0 2023-06-23T18:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9814fc10 con 0x7fdf980b4e10 2023-06-23T18:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9806f250 con 0x7fdf9806df50 2023-06-23T18:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34130/0 (socket says 172.21.15.38:34130) 2023-06-23T18:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 -- 172.21.15.38:0/1877400197 learned_addr learned my addr 172.21.15.38:0/1877400197 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf96ffd640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9813aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf977fe640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf980b4e10 0x7fdf9814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 -- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 msgr2=0x7fdf9813aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:04.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9813aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 -- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf980b4e10 msgr2=0x7fdf9814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:04.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf980b4e10 0x7fdf9814f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 -- 172.21.15.38:0/1877400197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0094d0 con 0x7fdf9806e7d0 2023-06-23T18:51:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf96ffd640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9813aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:51:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf967fc640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ad040 tx=0x7fdf8c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0b5810 con 0x7fdf9806e7d0 2023-06-23T18:51:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0b5990 con 0x7fdf9806e7d0 2023-06-23T18:51:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0b5d40 con 0x7fdf9806e7d0 2023-06-23T18:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9813a240 con 0x7fdf9806e7d0 2023-06-23T18:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.663+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9806f4a0 con 0x7fdf9806e7d0 2023-06-23T18:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98070d10 con 0x7fdf9806e7d0 2023-06-23T18:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf8c0bf410 con 0x7fdf9806e7d0 2023-06-23T18:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf7ffff640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 0x7fdf84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf8c11eae0 con 0x7fdf9806e7d0 2023-06-23T18:51:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf96ffd640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 0x7fdf84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.667+0000 7fdf96ffd640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 0x7fdf84068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf88007a70 tx=0x7fdf88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:04.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.671+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf98070d10 con 0x7fdf9806e7d0 2023-06-23T18:51:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.827+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf9806efd0 con 0x7fdf84066280 2023-06-23T18:51:04.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.855+0000 7fdf7ffff640 1 -- 172.21.15.38:0/1877400197 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+387924 (secure 0 0 0) 0x7fdf88007710 con 0x7fdf84066280 2023-06-23T18:51:04.869 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:51:04.871 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:51:04.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 msgr2=0x7fdf84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:04.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 0x7fdf84068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf88007a70 tx=0x7fdf88008040 comp rx=0 tx=0).stop 2023-06-23T18:51:04.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 msgr2=0x7fdf9814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:04.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ad040 tx=0x7fdf8c019270 comp rx=0 tx=0).stop 2023-06-23T18:51:04.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 shutdown_connections 2023-06-23T18:51:04.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fdf84066280 0x7fdf84068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf980b4e10 0x7fdf9814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf9806e7d0 0x7fdf9814f190 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 --2- 172.21.15.38:0/1877400197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf9806df50 0x7fdf9813aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:04.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 >> 172.21.15.38:0/1877400197 conn(0x7fdf980bfca0 msgr2=0x7fdf98146940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:04.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 shutdown_connections 2023-06-23T18:51:04.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:04.859+0000 7fdf9d986640 1 -- 172.21.15.38:0/1877400197 wait complete. 2023-06-23T18:51:04.888 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-06-23T18:51:03.284043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596702,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740216,"statfs":{"total":773094113280,"available":772853981184,"internally_reserved":0,"allocated":2564096,"data_stored":2162460,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005532"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302331+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:44.302331+0000","last_peered":"2023-06-23T18:49:44.302331+0000","last_clean":"2023-06-23T18:49:44.302331+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:44.302331+0000","last_undegraded":"2023-06-23T18:49:44.302331+0000","last_fullsized":"2023-06-23T18:49:44.302331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.630164+0000","last_change":"2023-06-23T18:51:01.630354+0000","last_active":"2023-06-23T18:51:01.630164+0000","last_peered":"2023-06-23T18:51:01.630164+0000","last_clean":"2023-06-23T18:51:01.630164+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:51:01.630164+0000","last_undegraded":"2023-06-23T18:51:01.630164+0000","last_fullsized":"2023-06-23T18:51:01.630164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.629955+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:47:56.036543+0000","scrub_duration":0.0081086479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549904+0000","last_change":"2023-06-23T18:49:36.816307+0000","last_active":"2023-06-23T18:49:41.549904+0000","last_peered":"2023-06-23T18:49:41.549904+0000","last_clean":"2023-06-23T18:49:41.549904+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:49:41.549904+0000","last_undegraded":"2023-06-23T18:49:41.549904+0000","last_fullsized":"2023-06-23T18:49:41.549904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302169+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:44.302169+0000","last_peered":"2023-06-23T18:49:44.302169+0000","last_clean":"2023-06-23T18:49:44.302169+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:44.302169+0000","last_undegraded":"2023-06-23T18:49:44.302169+0000","last_fullsized":"2023-06-23T18:49:44.302169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.589809+0000","last_change":"2023-06-23T18:50:58.589921+0000","last_active":"2023-06-23T18:50:58.589809+0000","last_peered":"2023-06-23T18:50:58.589809+0000","last_clean":"2023-06-23T18:50:58.589809+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:50:58.589809+0000","last_undegraded":"2023-06-23T18:50:58.589809+0000","last_fullsized":"2023-06-23T18:50:58.589809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.589589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:39.052945+0000","scrub_duration":0.0036881570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.023838+0000","last_change":"2023-06-23T18:50:50.023931+0000","last_active":"2023-06-23T18:50:50.023838+0000","last_peered":"2023-06-23T18:50:50.023838+0000","last_clean":"2023-06-23T18:50:50.023838+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:50:50.023838+0000","last_undegraded":"2023-06-23T18:50:50.023838+0000","last_fullsized":"2023-06-23T18:50:50.023838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.023624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.888239+0000","scrub_duration":0.0031280280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303259+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:44.303259+0000","last_peered":"2023-06-23T18:49:44.303259+0000","last_clean":"2023-06-23T18:49:44.303259+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:44.303259+0000","last_undegraded":"2023-06-23T18:49:44.303259+0000","last_fullsized":"2023-06-23T18:49:44.303259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.794729+0000","last_change":"2023-06-23T18:50:52.794857+0000","last_active":"2023-06-23T18:50:52.794729+0000","last_peered":"2023-06-23T18:50:52.794729+0000","last_clean":"2023-06-23T18:50:52.794729+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:50:52.794729+0000","last_undegraded":"2023-06-23T18:50:52.794729+0000","last_fullsized":"2023-06-23T18:50:52.794729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.794494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:15:53.603901+0000","scrub_duration":0.006501817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550240+0000","last_change":"2023-06-23T18:49:36.771686+0000","last_active":"2023-06-23T18:49:41.550240+0000","last_peered":"2023-06-23T18:49:41.550240+0000","last_clean":"2023-06-23T18:49:41.550240+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:49:41.550240+0000","last_undegraded":"2023-06-23T18:49:41.550240+0000","last_fullsized":"2023-06-23T18:49:41.550240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302349+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:44.302349+0000","last_peered":"2023-06-23T18:49:44.302349+0000","last_clean":"2023-06-23T18:49:44.302349+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:44.302349+0000","last_undegraded":"2023-06-23T18:49:44.302349+0000","last_fullsized":"2023-06-23T18:49:44.302349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553476+0000","last_change":"2023-06-23T18:49:36.394882+0000","last_active":"2023-06-23T18:49:41.553476+0000","last_peered":"2023-06-23T18:49:41.553476+0000","last_clean":"2023-06-23T18:49:41.553476+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:49:41.553476+0000","last_undegraded":"2023-06-23T18:49:41.553476+0000","last_fullsized":"2023-06-23T18:49:41.553476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550989+0000","last_change":"2023-06-23T18:49:36.789700+0000","last_active":"2023-06-23T18:49:41.550989+0000","last_peered":"2023-06-23T18:49:41.550989+0000","last_clean":"2023-06-23T18:49:41.550989+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:49:41.550989+0000","last_undegraded":"2023-06-23T18:49:41.550989+0000","last_fullsized":"2023-06-23T18:49:41.550989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302616+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:44.302616+0000","last_peered":"2023-06-23T18:49:44.302616+0000","last_clean":"2023-06-23T18:49:44.302616+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:44.302616+0000","last_undegraded":"2023-06-23T18:49:44.302616+0000","last_fullsized":"2023-06-23T18:49:44.302616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175513+0000","last_change":"2023-06-23T18:49:36.389019+0000","last_active":"2023-06-23T18:49:41.175513+0000","last_peered":"2023-06-23T18:49:41.175513+0000","last_clean":"2023-06-23T18:49:41.175513+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:49:41.175513+0000","last_undegraded":"2023-06-23T18:49:41.175513+0000","last_fullsized":"2023-06-23T18:49:41.175513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.081975+0000","last_change":"2023-06-23T18:50:58.082067+0000","last_active":"2023-06-23T18:50:58.081975+0000","last_peered":"2023-06-23T18:50:58.081975+0000","last_clean":"2023-06-23T18:50:58.081975+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:50:58.081975+0000","last_undegraded":"2023-06-23T18:50:58.081975+0000","last_fullsized":"2023-06-23T18:50:58.081975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.081770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:15.215107+0000","scrub_duration":0.0035039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303315+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:44.303315+0000","last_peered":"2023-06-23T18:49:44.303315+0000","last_clean":"2023-06-23T18:49:44.303315+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:44.303315+0000","last_undegraded":"2023-06-23T18:49:44.303315+0000","last_fullsized":"2023-06-23T18:49:44.303315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552817+0000","last_change":"2023-06-23T18:49:36.405854+0000","last_active":"2023-06-23T18:49:41.552817+0000","last_peered":"2023-06-23T18:49:41.552817+0000","last_clean":"2023-06-23T18:49:41.552817+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:49:41.552817+0000","last_undegraded":"2023-06-23T18:49:41.552817+0000","last_fullsized":"2023-06-23T18:49:41.552817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177905+0000","last_change":"2023-06-23T18:49:36.794645+0000","last_active":"2023-06-23T18:49:41.177905+0000","last_peered":"2023-06-23T18:49:41.177905+0000","last_clean":"2023-06-23T18:49:41.177905+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:49:41.177905+0000","last_undegraded":"2023-06-23T18:49:41.177905+0000","last_fullsized":"2023-06-23T18:49:41.177905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303433+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:44.303433+0000","last_peered":"2023-06-23T18:49:44.303433+0000","last_clean":"2023-06-23T18:49:44.303433+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:44.303433+0000","last_undegraded":"2023-06-23T18:49:44.303433+0000","last_fullsized":"2023-06-23T18:49:44.303433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175492+0000","last_change":"2023-06-23T18:49:36.376376+0000","last_active":"2023-06-23T18:49:41.175492+0000","last_peered":"2023-06-23T18:49:41.175492+0000","last_clean":"2023-06-23T18:49:41.175492+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:49:41.175492+0000","last_undegraded":"2023-06-23T18:49:41.175492+0000","last_fullsized":"2023-06-23T18:49:41.175492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.211395+0000","last_change":"2023-06-23T18:50:50.211554+0000","last_active":"2023-06-23T18:50:50.211395+0000","last_peered":"2023-06-23T18:50:50.211395+0000","last_clean":"2023-06-23T18:50:50.211395+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:50:50.211395+0000","last_undegraded":"2023-06-23T18:50:50.211395+0000","last_fullsized":"2023-06-23T18:50:50.211395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.211152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:38:55.024699+0000","scrub_duration":0.0034905040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.304053+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:43.304053+0000","last_peered":"2023-06-23T18:49:43.304053+0000","last_clean":"2023-06-23T18:49:43.304053+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:43.304053+0000","last_undegraded":"2023-06-23T18:49:43.304053+0000","last_fullsized":"2023-06-23T18:49:43.304053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.521370+0000","last_change":"2023-06-23T18:50:53.521469+0000","last_active":"2023-06-23T18:50:53.521370+0000","last_peered":"2023-06-23T18:50:53.521370+0000","last_clean":"2023-06-23T18:50:53.521370+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:50:53.521370+0000","last_undegraded":"2023-06-23T18:50:53.521370+0000","last_fullsized":"2023-06-23T18:50:53.521370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.521154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:12:32.302169+0000","scrub_duration":0.0038767810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.834683+0000","last_change":"2023-06-23T18:50:55.834781+0000","last_active":"2023-06-23T18:50:55.834683+0000","last_peered":"2023-06-23T18:50:55.834683+0000","last_clean":"2023-06-23T18:50:55.834683+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:50:55.834683+0000","last_undegraded":"2023-06-23T18:50:55.834683+0000","last_fullsized":"2023-06-23T18:50:55.834683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.834438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:19:22.644409+0000","scrub_duration":0.0035002900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175952+0000","last_change":"2023-06-23T18:49:36.789610+0000","last_active":"2023-06-23T18:49:41.175952+0000","last_peered":"2023-06-23T18:49:41.175952+0000","last_clean":"2023-06-23T18:49:41.175952+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:49:41.175952+0000","last_undegraded":"2023-06-23T18:49:41.175952+0000","last_fullsized":"2023-06-23T18:49:41.175952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.566433+0000","last_change":"2023-06-23T18:50:54.566595+0000","last_active":"2023-06-23T18:50:54.566433+0000","last_peered":"2023-06-23T18:50:54.566433+0000","last_clean":"2023-06-23T18:50:54.566433+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:50:54.566433+0000","last_undegraded":"2023-06-23T18:50:54.566433+0000","last_fullsized":"2023-06-23T18:50:54.566433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.566209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:15.460398+0000","scrub_duration":0.0040031069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.301913+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:44.301913+0000","last_peered":"2023-06-23T18:49:44.301913+0000","last_clean":"2023-06-23T18:49:44.301913+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:44.301913+0000","last_undegraded":"2023-06-23T18:49:44.301913+0000","last_fullsized":"2023-06-23T18:49:44.301913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.195109+0000","last_change":"2023-06-23T18:50:46.195216+0000","last_active":"2023-06-23T18:50:46.195109+0000","last_peered":"2023-06-23T18:50:46.195109+0000","last_clean":"2023-06-23T18:50:46.195109+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:50:46.195109+0000","last_undegraded":"2023-06-23T18:50:46.195109+0000","last_fullsized":"2023-06-23T18:50:46.195109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.194901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:05:11.372699+0000","scrub_duration":0.0039927290000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.242899+0000","last_change":"2023-06-23T18:50:44.242992+0000","last_active":"2023-06-23T18:50:44.242899+0000","last_peered":"2023-06-23T18:50:44.242899+0000","last_clean":"2023-06-23T18:50:44.242899+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:50:44.242899+0000","last_undegraded":"2023-06-23T18:50:44.242899+0000","last_fullsized":"2023-06-23T18:50:44.242899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.242702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:35.107318+0000","scrub_duration":0.0033288580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303098+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:44.303098+0000","last_peered":"2023-06-23T18:49:44.303098+0000","last_clean":"2023-06-23T18:49:44.303098+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:44.303098+0000","last_undegraded":"2023-06-23T18:49:44.303098+0000","last_fullsized":"2023-06-23T18:49:44.303098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.922718+0000","last_change":"2023-06-23T18:50:52.922831+0000","last_active":"2023-06-23T18:50:52.922718+0000","last_peered":"2023-06-23T18:50:52.922718+0000","last_clean":"2023-06-23T18:50:52.922718+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:50:52.922718+0000","last_undegraded":"2023-06-23T18:50:52.922718+0000","last_fullsized":"2023-06-23T18:50:52.922718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.922501+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.034066+0000","scrub_duration":0.0078325200000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.236438+0000","last_change":"2023-06-23T18:50:47.236534+0000","last_active":"2023-06-23T18:50:47.236438+0000","last_peered":"2023-06-23T18:50:47.236438+0000","last_clean":"2023-06-23T18:50:47.236438+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:50:47.236438+0000","last_undegraded":"2023-06-23T18:50:47.236438+0000","last_fullsized":"2023-06-23T18:50:47.236438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.236189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:23.521561+0000","scrub_duration":0.003811432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302501+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:44.302501+0000","last_peered":"2023-06-23T18:49:44.302501+0000","last_clean":"2023-06-23T18:49:44.302501+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:44.302501+0000","last_undegraded":"2023-06-23T18:49:44.302501+0000","last_fullsized":"2023-06-23T18:49:44.302501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'18","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:37.126377+0000","last_change":"2023-06-23T18:49:36.393692+0000","last_active":"2023-06-23T18:50:37.126377+0000","last_peered":"2023-06-23T18:50:37.126377+0000","last_clean":"2023-06-23T18:50:37.126377+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:50:37.126377+0000","last_undegraded":"2023-06-23T18:50:37.126377+0000","last_fullsized":"2023-06-23T18:50:37.126377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551133+0000","last_change":"2023-06-23T18:49:36.768123+0000","last_active":"2023-06-23T18:49:41.551133+0000","last_peered":"2023-06-23T18:49:41.551133+0000","last_clean":"2023-06-23T18:49:41.551133+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:49:41.551133+0000","last_undegraded":"2023-06-23T18:49:41.551133+0000","last_fullsized":"2023-06-23T18:49:41.551133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303905+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:43.303905+0000","last_peered":"2023-06-23T18:49:43.303905+0000","last_clean":"2023-06-23T18:49:43.303905+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:43.303905+0000","last_undegraded":"2023-06-23T18:49:43.303905+0000","last_fullsized":"2023-06-23T18:49:43.303905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550183+0000","last_change":"2023-06-23T18:49:36.770040+0000","last_active":"2023-06-23T18:49:41.550183+0000","last_peered":"2023-06-23T18:49:41.550183+0000","last_clean":"2023-06-23T18:49:41.550183+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:49:41.550183+0000","last_undegraded":"2023-06-23T18:49:41.550183+0000","last_fullsized":"2023-06-23T18:49:41.550183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.555000+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.555000+0000","last_peered":"2023-06-23T18:49:41.555000+0000","last_clean":"2023-06-23T18:49:41.555000+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.555000+0000","last_undegraded":"2023-06-23T18:49:41.555000+0000","last_fullsized":"2023-06-23T18:49:41.555000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175452+0000","last_change":"2023-06-23T18:49:36.378284+0000","last_active":"2023-06-23T18:49:41.175452+0000","last_peered":"2023-06-23T18:49:41.175452+0000","last_clean":"2023-06-23T18:49:41.175452+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:49:41.175452+0000","last_undegraded":"2023-06-23T18:49:41.175452+0000","last_fullsized":"2023-06-23T18:49:41.175452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302221+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:44.302221+0000","last_peered":"2023-06-23T18:49:44.302221+0000","last_clean":"2023-06-23T18:49:44.302221+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:44.302221+0000","last_undegraded":"2023-06-23T18:49:44.302221+0000","last_fullsized":"2023-06-23T18:49:44.302221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.173667+0000","last_change":"2023-06-23T18:49:36.798263+0000","last_active":"2023-06-23T18:49:41.173667+0000","last_peered":"2023-06-23T18:49:41.173667+0000","last_clean":"2023-06-23T18:49:41.173667+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:49:41.173667+0000","last_undegraded":"2023-06-23T18:49:41.173667+0000","last_fullsized":"2023-06-23T18:49:41.173667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176190+0000","last_change":"2023-06-23T18:49:32.316506+0000","last_active":"2023-06-23T18:49:41.176190+0000","last_peered":"2023-06-23T18:49:41.176190+0000","last_clean":"2023-06-23T18:49:41.176190+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:49:41.176190+0000","last_undegraded":"2023-06-23T18:49:41.176190+0000","last_fullsized":"2023-06-23T18:49:41.176190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176228+0000","last_change":"2023-06-23T18:49:36.395561+0000","last_active":"2023-06-23T18:49:41.176228+0000","last_peered":"2023-06-23T18:49:41.176228+0000","last_clean":"2023-06-23T18:49:41.176228+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:49:41.176228+0000","last_undegraded":"2023-06-23T18:49:41.176228+0000","last_fullsized":"2023-06-23T18:49:41.176228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.301946+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:44.301946+0000","last_peered":"2023-06-23T18:49:44.301946+0000","last_clean":"2023-06-23T18:49:44.301946+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:44.301946+0000","last_undegraded":"2023-06-23T18:49:44.301946+0000","last_fullsized":"2023-06-23T18:49:44.301946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547464+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547464+0000","last_peered":"2023-06-23T18:49:41.547464+0000","last_clean":"2023-06-23T18:49:41.547464+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547464+0000","last_undegraded":"2023-06-23T18:49:41.547464+0000","last_fullsized":"2023-06-23T18:49:41.547464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554710+0000","last_change":"2023-06-23T18:49:32.327733+0000","last_active":"2023-06-23T18:49:41.554710+0000","last_peered":"2023-06-23T18:49:41.554710+0000","last_clean":"2023-06-23T18:49:41.554710+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:49:41.554710+0000","last_undegraded":"2023-06-23T18:49:41.554710+0000","last_fullsized":"2023-06-23T18:49:41.554710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.492419+0000","last_change":"2023-06-23T18:50:49.492510+0000","last_active":"2023-06-23T18:50:49.492419+0000","last_peered":"2023-06-23T18:50:49.492419+0000","last_clean":"2023-06-23T18:50:49.492419+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:50:49.492419+0000","last_undegraded":"2023-06-23T18:50:49.492419+0000","last_fullsized":"2023-06-23T18:50:49.492419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.492191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:08:58.030503+0000","scrub_duration":0.003101272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303173+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:44.303173+0000","last_peered":"2023-06-23T18:49:44.303173+0000","last_clean":"2023-06-23T18:49:44.303173+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:44.303173+0000","last_undegraded":"2023-06-23T18:49:44.303173+0000","last_fullsized":"2023-06-23T18:49:44.303173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546083+0000","last_change":"2023-06-23T18:49:36.769116+0000","last_active":"2023-06-23T18:49:41.546083+0000","last_peered":"2023-06-23T18:49:41.546083+0000","last_clean":"2023-06-23T18:49:41.546083+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:49:41.546083+0000","last_undegraded":"2023-06-23T18:49:41.546083+0000","last_fullsized":"2023-06-23T18:49:41.546083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.534098+0000","last_change":"2023-06-23T18:50:52.534195+0000","last_active":"2023-06-23T18:50:52.534098+0000","last_peered":"2023-06-23T18:50:52.534098+0000","last_clean":"2023-06-23T18:50:52.534098+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:50:52.534098+0000","last_undegraded":"2023-06-23T18:50:52.534098+0000","last_fullsized":"2023-06-23T18:50:52.534098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.533877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:49.679167+0000","scrub_duration":0.0032420919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:43.232613+0000","last_change":"2023-06-23T18:50:43.232656+0000","last_active":"2023-06-23T18:50:43.232613+0000","last_peered":"2023-06-23T18:50:43.232613+0000","last_clean":"2023-06-23T18:50:43.232613+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:50:43.232613+0000","last_undegraded":"2023-06-23T18:50:43.232613+0000","last_fullsized":"2023-06-23T18:50:43.232613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_clean_scrub_stamp":"2023-06-23T18:50:43.232516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:25.567882+0000","scrub_duration":0.0029476870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302527+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:44.302527+0000","last_peered":"2023-06-23T18:49:44.302527+0000","last_clean":"2023-06-23T18:49:44.302527+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:44.302527+0000","last_undegraded":"2023-06-23T18:49:44.302527+0000","last_fullsized":"2023-06-23T18:49:44.302527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548140+0000","last_change":"2023-06-23T18:49:36.790868+0000","last_active":"2023-06-23T18:49:41.548140+0000","last_peered":"2023-06-23T18:49:41.548140+0000","last_clean":"2023-06-23T18:49:41.548140+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:49:41.548140+0000","last_undegraded":"2023-06-23T18:49:41.548140+0000","last_fullsized":"2023-06-23T18:49:41.548140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:45.885459+0000","last_change":"2023-06-23T18:50:45.885555+0000","last_active":"2023-06-23T18:50:45.885459+0000","last_peered":"2023-06-23T18:50:45.885459+0000","last_clean":"2023-06-23T18:50:45.885459+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:50:45.885459+0000","last_undegraded":"2023-06-23T18:50:45.885459+0000","last_fullsized":"2023-06-23T18:50:45.885459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_clean_scrub_stamp":"2023-06-23T18:50:45.885234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.476258+0000","scrub_duration":0.0032745949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554362+0000","last_change":"2023-06-23T18:49:32.681650+0000","last_active":"2023-06-23T18:49:41.554362+0000","last_peered":"2023-06-23T18:49:41.554362+0000","last_clean":"2023-06-23T18:49:41.554362+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:49:41.554362+0000","last_undegraded":"2023-06-23T18:49:41.554362+0000","last_fullsized":"2023-06-23T18:49:41.554362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302131+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:44.302131+0000","last_peered":"2023-06-23T18:49:44.302131+0000","last_clean":"2023-06-23T18:49:44.302131+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:44.302131+0000","last_undegraded":"2023-06-23T18:49:44.302131+0000","last_fullsized":"2023-06-23T18:49:44.302131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548249+0000","last_change":"2023-06-23T18:49:36.774974+0000","last_active":"2023-06-23T18:49:41.548249+0000","last_peered":"2023-06-23T18:49:41.548249+0000","last_clean":"2023-06-23T18:49:41.548249+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:49:41.548249+0000","last_undegraded":"2023-06-23T18:49:41.548249+0000","last_fullsized":"2023-06-23T18:49:41.548249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:59.619803+0000","last_change":"2023-06-23T18:50:59.619897+0000","last_active":"2023-06-23T18:50:59.619803+0000","last_peered":"2023-06-23T18:50:59.619803+0000","last_clean":"2023-06-23T18:50:59.619803+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:50:59.619803+0000","last_undegraded":"2023-06-23T18:50:59.619803+0000","last_fullsized":"2023-06-23T18:50:59.619803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_clean_scrub_stamp":"2023-06-23T18:50:59.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:40:36.386104+0000","scrub_duration":0.0065439850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.029209+0000","last_change":"2023-06-23T18:50:46.029369+0000","last_active":"2023-06-23T18:50:46.029209+0000","last_peered":"2023-06-23T18:50:46.029209+0000","last_clean":"2023-06-23T18:50:46.029209+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:50:46.029209+0000","last_undegraded":"2023-06-23T18:50:46.029209+0000","last_fullsized":"2023-06-23T18:50:46.029209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.028949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.619973+0000","scrub_duration":0.0030831489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302209+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:44.302209+0000","last_peered":"2023-06-23T18:49:44.302209+0000","last_clean":"2023-06-23T18:49:44.302209+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:44.302209+0000","last_undegraded":"2023-06-23T18:49:44.302209+0000","last_fullsized":"2023-06-23T18:49:44.302209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547031+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.547031+0000","last_peered":"2023-06-23T18:49:41.547031+0000","last_clean":"2023-06-23T18:49:41.547031+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.547031+0000","last_undegraded":"2023-06-23T18:49:41.547031+0000","last_fullsized":"2023-06-23T18:49:41.547031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.504742+0000","last_change":"2023-06-23T18:50:50.504828+0000","last_active":"2023-06-23T18:50:50.504742+0000","last_peered":"2023-06-23T18:50:50.504742+0000","last_clean":"2023-06-23T18:50:50.504742+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:50:50.504742+0000","last_undegraded":"2023-06-23T18:50:50.504742+0000","last_fullsized":"2023-06-23T18:50:50.504742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.504552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:37.616116+0000","scrub_duration":0.0037428470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549351+0000","last_change":"2023-06-23T18:49:32.330256+0000","last_active":"2023-06-23T18:49:41.549351+0000","last_peered":"2023-06-23T18:49:41.549351+0000","last_clean":"2023-06-23T18:49:41.549351+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:49:41.549351+0000","last_undegraded":"2023-06-23T18:49:41.549351+0000","last_fullsized":"2023-06-23T18:49:41.549351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302358+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:44.302358+0000","last_peered":"2023-06-23T18:49:44.302358+0000","last_clean":"2023-06-23T18:49:44.302358+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:44.302358+0000","last_undegraded":"2023-06-23T18:49:44.302358+0000","last_fullsized":"2023-06-23T18:49:44.302358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554487+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554487+0000","last_peered":"2023-06-23T18:49:41.554487+0000","last_clean":"2023-06-23T18:49:41.554487+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554487+0000","last_undegraded":"2023-06-23T18:49:41.554487+0000","last_fullsized":"2023-06-23T18:49:41.554487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174534+0000","last_change":"2023-06-23T18:49:36.382348+0000","last_active":"2023-06-23T18:49:41.174534+0000","last_peered":"2023-06-23T18:49:41.174534+0000","last_clean":"2023-06-23T18:49:41.174534+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:49:41.174534+0000","last_undegraded":"2023-06-23T18:49:41.174534+0000","last_fullsized":"2023-06-23T18:49:41.174534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553053+0000","last_change":"2023-06-23T18:49:32.490277+0000","last_active":"2023-06-23T18:49:41.553053+0000","last_peered":"2023-06-23T18:49:41.553053+0000","last_clean":"2023-06-23T18:49:41.553053+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:49:41.553053+0000","last_undegraded":"2023-06-23T18:49:41.553053+0000","last_fullsized":"2023-06-23T18:49:41.553053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.397361+0000","last_change":"2023-06-23T18:50:55.397477+0000","last_active":"2023-06-23T18:50:55.397361+0000","last_peered":"2023-06-23T18:50:55.397361+0000","last_clean":"2023-06-23T18:50:55.397361+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:50:55.397361+0000","last_undegraded":"2023-06-23T18:50:55.397361+0000","last_fullsized":"2023-06-23T18:50:55.397361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.397147+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:51:58.950573+0000","scrub_duration":0.013609326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303250+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:44.303250+0000","last_peered":"2023-06-23T18:49:44.303250+0000","last_clean":"2023-06-23T18:49:44.303250+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:44.303250+0000","last_undegraded":"2023-06-23T18:49:44.303250+0000","last_fullsized":"2023-06-23T18:49:44.303250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177553+0000","last_change":"2023-06-23T18:49:36.799258+0000","last_active":"2023-06-23T18:49:41.177553+0000","last_peered":"2023-06-23T18:49:41.177553+0000","last_clean":"2023-06-23T18:49:41.177553+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:49:41.177553+0000","last_undegraded":"2023-06-23T18:49:41.177553+0000","last_fullsized":"2023-06-23T18:49:41.177553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.174956+0000","last_change":"2023-06-23T18:49:36.375979+0000","last_active":"2023-06-23T18:49:41.174956+0000","last_peered":"2023-06-23T18:49:41.174956+0000","last_clean":"2023-06-23T18:49:41.174956+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:49:41.174956+0000","last_undegraded":"2023-06-23T18:49:41.174956+0000","last_fullsized":"2023-06-23T18:49:41.174956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302329+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:44.302329+0000","last_peered":"2023-06-23T18:49:44.302329+0000","last_clean":"2023-06-23T18:49:44.302329+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:44.302329+0000","last_undegraded":"2023-06-23T18:49:44.302329+0000","last_fullsized":"2023-06-23T18:49:44.302329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551270+0000","last_change":"2023-06-23T18:49:36.768696+0000","last_active":"2023-06-23T18:49:41.551270+0000","last_peered":"2023-06-23T18:49:41.551270+0000","last_clean":"2023-06-23T18:49:41.551270+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:49:41.551270+0000","last_undegraded":"2023-06-23T18:49:41.551270+0000","last_fullsized":"2023-06-23T18:49:41.551270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552241+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552241+0000","last_peered":"2023-06-23T18:49:41.552241+0000","last_clean":"2023-06-23T18:49:41.552241+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552241+0000","last_undegraded":"2023-06-23T18:49:41.552241+0000","last_fullsized":"2023-06-23T18:49:41.552241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302491+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:44.302491+0000","last_peered":"2023-06-23T18:49:44.302491+0000","last_clean":"2023-06-23T18:49:44.302491+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:44.302491+0000","last_undegraded":"2023-06-23T18:49:44.302491+0000","last_fullsized":"2023-06-23T18:49:44.302491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.797511+0000","last_change":"2023-06-23T18:50:50.797602+0000","last_active":"2023-06-23T18:50:50.797511+0000","last_peered":"2023-06-23T18:50:50.797511+0000","last_clean":"2023-06-23T18:50:50.797511+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:50:50.797511+0000","last_undegraded":"2023-06-23T18:50:50.797511+0000","last_fullsized":"2023-06-23T18:50:50.797511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.797299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:30:37.953962+0000","scrub_duration":0.0033459710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.784633+0000","last_change":"2023-06-23T18:50:58.784725+0000","last_active":"2023-06-23T18:50:58.784633+0000","last_peered":"2023-06-23T18:50:58.784633+0000","last_clean":"2023-06-23T18:50:58.784633+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:50:58.784633+0000","last_undegraded":"2023-06-23T18:50:58.784633+0000","last_fullsized":"2023-06-23T18:50:58.784633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.784419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:02.814290+0000","scrub_duration":0.0033385580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:42.296160+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:42.296160+0000","last_peered":"2023-06-23T18:49:42.296160+0000","last_clean":"2023-06-23T18:49:42.296160+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:42.296160+0000","last_undegraded":"2023-06-23T18:49:42.296160+0000","last_fullsized":"2023-06-23T18:49:42.296160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176059+0000","last_change":"2023-06-23T18:49:36.815510+0000","last_active":"2023-06-23T18:49:41.176059+0000","last_peered":"2023-06-23T18:49:41.176059+0000","last_clean":"2023-06-23T18:49:41.176059+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:49:41.176059+0000","last_undegraded":"2023-06-23T18:49:41.176059+0000","last_fullsized":"2023-06-23T18:49:41.176059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.058715+0000","last_change":"2023-06-23T18:50:49.058838+0000","last_active":"2023-06-23T18:50:49.058715+0000","last_peered":"2023-06-23T18:50:49.058715+0000","last_clean":"2023-06-23T18:50:49.058715+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:50:49.058715+0000","last_undegraded":"2023-06-23T18:50:49.058715+0000","last_fullsized":"2023-06-23T18:50:49.058715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.058507+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.393874+0000","scrub_duration":0.0062727069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302070+0000","last_change":"2023-06-23T18:49:40.836287+0000","last_active":"2023-06-23T18:49:44.302070+0000","last_peered":"2023-06-23T18:49:44.302070+0000","last_clean":"2023-06-23T18:49:44.302070+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:49:44.302070+0000","last_undegraded":"2023-06-23T18:49:44.302070+0000","last_fullsized":"2023-06-23T18:49:44.302070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547942+0000","last_change":"2023-06-23T18:49:36.812535+0000","last_active":"2023-06-23T18:49:41.547942+0000","last_peered":"2023-06-23T18:49:41.547942+0000","last_clean":"2023-06-23T18:49:41.547942+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:49:41.547942+0000","last_undegraded":"2023-06-23T18:49:41.547942+0000","last_fullsized":"2023-06-23T18:49:41.547942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:48.953800+0000","last_change":"2023-06-23T18:50:48.953903+0000","last_active":"2023-06-23T18:50:48.953800+0000","last_peered":"2023-06-23T18:50:48.953800+0000","last_clean":"2023-06-23T18:50:48.953800+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:50:48.953800+0000","last_undegraded":"2023-06-23T18:50:48.953800+0000","last_fullsized":"2023-06-23T18:50:48.953800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_clean_scrub_stamp":"2023-06-23T18:50:48.953602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.288968+0000","scrub_duration":0.0038302459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303934+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:43.303934+0000","last_peered":"2023-06-23T18:49:43.303934+0000","last_clean":"2023-06-23T18:49:43.303934+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:43.303934+0000","last_undegraded":"2023-06-23T18:49:43.303934+0000","last_fullsized":"2023-06-23T18:49:43.303934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550645+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550645+0000","last_peered":"2023-06-23T18:49:41.550645+0000","last_clean":"2023-06-23T18:49:41.550645+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550645+0000","last_undegraded":"2023-06-23T18:49:41.550645+0000","last_fullsized":"2023-06-23T18:49:41.550645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.805977+0000","last_change":"2023-06-23T18:50:54.806099+0000","last_active":"2023-06-23T18:50:54.805977+0000","last_peered":"2023-06-23T18:50:54.805977+0000","last_clean":"2023-06-23T18:50:54.805977+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:50:54.805977+0000","last_undegraded":"2023-06-23T18:50:54.805977+0000","last_fullsized":"2023-06-23T18:50:54.805977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.805774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:15:14.043224+0000","scrub_duration":0.0073158950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:42.296051+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:42.296051+0000","last_peered":"2023-06-23T18:49:42.296051+0000","last_clean":"2023-06-23T18:49:42.296051+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:42.296051+0000","last_undegraded":"2023-06-23T18:49:42.296051+0000","last_fullsized":"2023-06-23T18:49:42.296051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552328+0000","last_change":"2023-06-23T18:49:36.801849+0000","last_active":"2023-06-23T18:49:41.552328+0000","last_peered":"2023-06-23T18:49:41.552328+0000","last_clean":"2023-06-23T18:49:41.552328+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:49:41.552328+0000","last_undegraded":"2023-06-23T18:49:41.552328+0000","last_fullsized":"2023-06-23T18:49:41.552328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.262886+0000","last_change":"2023-06-23T18:50:47.263007+0000","last_active":"2023-06-23T18:50:47.262886+0000","last_peered":"2023-06-23T18:50:47.262886+0000","last_clean":"2023-06-23T18:50:47.262886+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:50:47.262886+0000","last_undegraded":"2023-06-23T18:50:47.262886+0000","last_fullsized":"2023-06-23T18:50:47.262886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.262681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:34.374245+0000","scrub_duration":0.0065258790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303836+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:43.303836+0000","last_peered":"2023-06-23T18:49:43.303836+0000","last_clean":"2023-06-23T18:49:43.303836+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:43.303836+0000","last_undegraded":"2023-06-23T18:49:43.303836+0000","last_fullsized":"2023-06-23T18:49:43.303836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549162+0000","last_change":"2023-06-23T18:49:36.768174+0000","last_active":"2023-06-23T18:49:41.549162+0000","last_peered":"2023-06-23T18:49:41.549162+0000","last_clean":"2023-06-23T18:49:41.549162+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:49:41.549162+0000","last_undegraded":"2023-06-23T18:49:41.549162+0000","last_fullsized":"2023-06-23T18:49:41.549162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.000041+0000","last_change":"2023-06-23T18:50:50.000146+0000","last_active":"2023-06-23T18:50:50.000041+0000","last_peered":"2023-06-23T18:50:50.000041+0000","last_clean":"2023-06-23T18:50:50.000041+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:50:50.000041+0000","last_undegraded":"2023-06-23T18:50:50.000041+0000","last_fullsized":"2023-06-23T18:50:50.000041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.999846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.864462+0000","scrub_duration":0.0065858610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302299+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:44.302299+0000","last_peered":"2023-06-23T18:49:44.302299+0000","last_clean":"2023-06-23T18:49:44.302299+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:44.302299+0000","last_undegraded":"2023-06-23T18:49:44.302299+0000","last_fullsized":"2023-06-23T18:49:44.302299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302301+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:44.302301+0000","last_peered":"2023-06-23T18:49:44.302301+0000","last_clean":"2023-06-23T18:49:44.302301+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:44.302301+0000","last_undegraded":"2023-06-23T18:49:44.302301+0000","last_fullsized":"2023-06-23T18:49:44.302301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.551286+0000","last_change":"2023-06-23T18:49:36.406040+0000","last_active":"2023-06-23T18:49:41.551286+0000","last_peered":"2023-06-23T18:49:41.551286+0000","last_clean":"2023-06-23T18:49:41.551286+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:49:41.551286+0000","last_undegraded":"2023-06-23T18:49:41.551286+0000","last_fullsized":"2023-06-23T18:49:41.551286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546822+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546822+0000","last_peered":"2023-06-23T18:49:41.546822+0000","last_clean":"2023-06-23T18:49:41.546822+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546822+0000","last_undegraded":"2023-06-23T18:49:41.546822+0000","last_fullsized":"2023-06-23T18:49:41.546822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302695+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:44.302695+0000","last_peered":"2023-06-23T18:49:44.302695+0000","last_clean":"2023-06-23T18:49:44.302695+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:44.302695+0000","last_undegraded":"2023-06-23T18:49:44.302695+0000","last_fullsized":"2023-06-23T18:49:44.302695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546839+0000","last_change":"2023-06-23T18:49:36.791481+0000","last_active":"2023-06-23T18:49:41.546839+0000","last_peered":"2023-06-23T18:49:41.546839+0000","last_clean":"2023-06-23T18:49:41.546839+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:49:41.546839+0000","last_undegraded":"2023-06-23T18:49:41.546839+0000","last_fullsized":"2023-06-23T18:49:41.546839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.502252+0000","last_change":"2023-06-23T18:50:47.502356+0000","last_active":"2023-06-23T18:50:47.502252+0000","last_peered":"2023-06-23T18:50:47.502252+0000","last_clean":"2023-06-23T18:50:47.502252+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:50:47.502252+0000","last_undegraded":"2023-06-23T18:50:47.502252+0000","last_fullsized":"2023-06-23T18:50:47.502252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.502043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:29.837409+0000","scrub_duration":0.0040377850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.792097+0000","last_change":"2023-06-23T18:50:53.792192+0000","last_active":"2023-06-23T18:50:53.792097+0000","last_peered":"2023-06-23T18:50:53.792097+0000","last_clean":"2023-06-23T18:50:53.792097+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:50:53.792097+0000","last_undegraded":"2023-06-23T18:50:53.792097+0000","last_fullsized":"2023-06-23T18:50:53.792097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.791890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:31.408545+0000","scrub_duration":0.0032528520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302578+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:44.302578+0000","last_peered":"2023-06-23T18:49:44.302578+0000","last_clean":"2023-06-23T18:49:44.302578+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:44.302578+0000","last_undegraded":"2023-06-23T18:49:44.302578+0000","last_fullsized":"2023-06-23T18:49:44.302578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552922+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552922+0000","last_peered":"2023-06-23T18:49:41.552922+0000","last_clean":"2023-06-23T18:49:41.552922+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552922+0000","last_undegraded":"2023-06-23T18:49:41.552922+0000","last_fullsized":"2023-06-23T18:49:41.552922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547852+0000","last_change":"2023-06-23T18:49:36.810720+0000","last_active":"2023-06-23T18:49:41.547852+0000","last_peered":"2023-06-23T18:49:41.547852+0000","last_clean":"2023-06-23T18:49:41.547852+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:49:41.547852+0000","last_undegraded":"2023-06-23T18:49:41.547852+0000","last_fullsized":"2023-06-23T18:49:41.547852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302111+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:44.302111+0000","last_peered":"2023-06-23T18:49:44.302111+0000","last_clean":"2023-06-23T18:49:44.302111+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:44.302111+0000","last_undegraded":"2023-06-23T18:49:44.302111+0000","last_fullsized":"2023-06-23T18:49:44.302111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550975+0000","last_change":"2023-06-23T18:49:36.816739+0000","last_active":"2023-06-23T18:49:41.550975+0000","last_peered":"2023-06-23T18:49:41.550975+0000","last_clean":"2023-06-23T18:49:41.550975+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:49:41.550975+0000","last_undegraded":"2023-06-23T18:49:41.550975+0000","last_fullsized":"2023-06-23T18:49:41.550975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545133+0000","last_change":"2023-06-23T18:49:36.796665+0000","last_active":"2023-06-23T18:49:41.545133+0000","last_peered":"2023-06-23T18:49:41.545133+0000","last_clean":"2023-06-23T18:49:41.545133+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:49:41.545133+0000","last_undegraded":"2023-06-23T18:49:41.545133+0000","last_fullsized":"2023-06-23T18:49:41.545133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176563+0000","last_change":"2023-06-23T18:49:36.767089+0000","last_active":"2023-06-23T18:49:41.176563+0000","last_peered":"2023-06-23T18:49:41.176563+0000","last_clean":"2023-06-23T18:49:41.176563+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:49:41.176563+0000","last_undegraded":"2023-06-23T18:49:41.176563+0000","last_fullsized":"2023-06-23T18:49:41.176563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547902+0000","last_change":"2023-06-23T18:49:36.790017+0000","last_active":"2023-06-23T18:49:41.547902+0000","last_peered":"2023-06-23T18:49:41.547902+0000","last_clean":"2023-06-23T18:49:41.547902+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:49:41.547902+0000","last_undegraded":"2023-06-23T18:49:41.547902+0000","last_fullsized":"2023-06-23T18:49:41.547902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547070+0000","last_change":"2023-06-23T18:49:36.787970+0000","last_active":"2023-06-23T18:49:41.547070+0000","last_peered":"2023-06-23T18:49:41.547070+0000","last_clean":"2023-06-23T18:49:41.547070+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:49:41.547070+0000","last_undegraded":"2023-06-23T18:49:41.547070+0000","last_fullsized":"2023-06-23T18:49:41.547070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554711+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554711+0000","last_peered":"2023-06-23T18:49:41.554711+0000","last_clean":"2023-06-23T18:49:41.554711+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554711+0000","last_undegraded":"2023-06-23T18:49:41.554711+0000","last_fullsized":"2023-06-23T18:49:41.554711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.177601+0000","last_change":"2023-06-23T18:49:36.813199+0000","last_active":"2023-06-23T18:49:41.177601+0000","last_peered":"2023-06-23T18:49:41.177601+0000","last_clean":"2023-06-23T18:49:41.177601+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:49:41.177601+0000","last_undegraded":"2023-06-23T18:49:41.177601+0000","last_fullsized":"2023-06-23T18:49:41.177601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.172564+0000","last_change":"2023-06-23T18:50:53.172651+0000","last_active":"2023-06-23T18:50:53.172564+0000","last_peered":"2023-06-23T18:50:53.172564+0000","last_clean":"2023-06-23T18:50:53.172564+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:50:53.172564+0000","last_undegraded":"2023-06-23T18:50:53.172564+0000","last_fullsized":"2023-06-23T18:50:53.172564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.172373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:06.374063+0000","scrub_duration":0.0034361800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550686+0000","last_change":"2023-06-23T18:49:36.802310+0000","last_active":"2023-06-23T18:49:41.550686+0000","last_peered":"2023-06-23T18:49:41.550686+0000","last_clean":"2023-06-23T18:49:41.550686+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:49:41.550686+0000","last_undegraded":"2023-06-23T18:49:41.550686+0000","last_fullsized":"2023-06-23T18:49:41.550686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:57.128158+0000","last_change":"2023-06-23T18:50:57.128267+0000","last_active":"2023-06-23T18:50:57.128158+0000","last_peered":"2023-06-23T18:50:57.128158+0000","last_clean":"2023-06-23T18:50:57.128158+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:50:57.128158+0000","last_undegraded":"2023-06-23T18:50:57.128158+0000","last_fullsized":"2023-06-23T18:50:57.128158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_clean_scrub_stamp":"2023-06-23T18:50:57.127936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:31.182068+0000","scrub_duration":0.0033896339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.010216+0000","last_change":"2023-06-23T18:50:53.010312+0000","last_active":"2023-06-23T18:50:53.010216+0000","last_peered":"2023-06-23T18:50:53.010216+0000","last_clean":"2023-06-23T18:50:53.010216+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:50:53.010216+0000","last_undegraded":"2023-06-23T18:50:53.010216+0000","last_fullsized":"2023-06-23T18:50:53.010216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.010001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.121565+0000","scrub_duration":0.0034279800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553104+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553104+0000","last_peered":"2023-06-23T18:49:41.553104+0000","last_clean":"2023-06-23T18:49:41.553104+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553104+0000","last_undegraded":"2023-06-23T18:49:41.553104+0000","last_fullsized":"2023-06-23T18:49:41.553104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553439+0000","last_change":"2023-06-23T18:49:36.816747+0000","last_active":"2023-06-23T18:49:41.553439+0000","last_peered":"2023-06-23T18:49:41.553439+0000","last_clean":"2023-06-23T18:49:41.553439+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:49:41.553439+0000","last_undegraded":"2023-06-23T18:49:41.553439+0000","last_fullsized":"2023-06-23T18:49:41.553439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.548250+0000","last_change":"2023-06-23T18:49:36.765311+0000","last_active":"2023-06-23T18:49:41.548250+0000","last_peered":"2023-06-23T18:49:41.548250+0000","last_clean":"2023-06-23T18:49:41.548250+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:49:41.548250+0000","last_undegraded":"2023-06-23T18:49:41.548250+0000","last_fullsized":"2023-06-23T18:49:41.548250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176376+0000","last_change":"2023-06-23T18:49:36.794839+0000","last_active":"2023-06-23T18:49:41.176376+0000","last_peered":"2023-06-23T18:49:41.176376+0000","last_clean":"2023-06-23T18:49:41.176376+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:49:41.176376+0000","last_undegraded":"2023-06-23T18:49:41.176376+0000","last_fullsized":"2023-06-23T18:49:41.176376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.037999+0000","last_change":"2023-06-23T18:50:55.038156+0000","last_active":"2023-06-23T18:50:55.037999+0000","last_peered":"2023-06-23T18:50:55.037999+0000","last_clean":"2023-06-23T18:50:55.037999+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:50:55.037999+0000","last_undegraded":"2023-06-23T18:50:55.037999+0000","last_fullsized":"2023-06-23T18:50:55.037999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.037786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.318885+0000","scrub_duration":0.0033358239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.840672+0000","last_change":"2023-06-23T18:50:47.840761+0000","last_active":"2023-06-23T18:50:47.840672+0000","last_peered":"2023-06-23T18:50:47.840672+0000","last_clean":"2023-06-23T18:50:47.840672+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:50:47.840672+0000","last_undegraded":"2023-06-23T18:50:47.840672+0000","last_fullsized":"2023-06-23T18:50:47.840672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.840462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:48.032261+0000","scrub_duration":0.0036463200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.964011+0000","last_change":"2023-06-23T18:50:54.964106+0000","last_active":"2023-06-23T18:50:54.964011+0000","last_peered":"2023-06-23T18:50:54.964011+0000","last_clean":"2023-06-23T18:50:54.964011+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:50:54.964011+0000","last_undegraded":"2023-06-23T18:50:54.964011+0000","last_fullsized":"2023-06-23T18:50:54.964011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.244910+0000","scrub_duration":0.0037456719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552541+0000","last_change":"2023-06-23T18:49:36.801556+0000","last_active":"2023-06-23T18:49:41.552541+0000","last_peered":"2023-06-23T18:49:41.552541+0000","last_clean":"2023-06-23T18:49:41.552541+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:49:41.552541+0000","last_undegraded":"2023-06-23T18:49:41.552541+0000","last_fullsized":"2023-06-23T18:49:41.552541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545628+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545628+0000","last_peered":"2023-06-23T18:49:41.545628+0000","last_clean":"2023-06-23T18:49:41.545628+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545628+0000","last_undegraded":"2023-06-23T18:49:41.545628+0000","last_fullsized":"2023-06-23T18:49:41.545628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.569431+0000","last_change":"2023-06-23T18:50:49.569592+0000","last_active":"2023-06-23T18:50:49.569431+0000","last_peered":"2023-06-23T18:50:49.569431+0000","last_clean":"2023-06-23T18:50:49.569431+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:50:49.569431+0000","last_undegraded":"2023-06-23T18:50:49.569431+0000","last_fullsized":"2023-06-23T18:50:49.569431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.569200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:29:53.991735+0000","scrub_duration":0.0038698320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.353794+0000","last_change":"2023-06-23T18:50:53.353850+0000","last_active":"2023-06-23T18:50:53.353794+0000","last_peered":"2023-06-23T18:50:53.353794+0000","last_clean":"2023-06-23T18:50:53.353794+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:50:53.353794+0000","last_undegraded":"2023-06-23T18:50:53.353794+0000","last_fullsized":"2023-06-23T18:50:53.353794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.353661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:14.491900+0000","scrub_duration":0.0026633910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554238+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554238+0000","last_peered":"2023-06-23T18:49:41.554238+0000","last_clean":"2023-06-23T18:49:41.554238+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554238+0000","last_undegraded":"2023-06-23T18:49:41.554238+0000","last_fullsized":"2023-06-23T18:49:41.554238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.249294+0000","last_change":"2023-06-23T18:50:44.249389+0000","last_active":"2023-06-23T18:50:44.249294+0000","last_peered":"2023-06-23T18:50:44.249294+0000","last_clean":"2023-06-23T18:50:44.249294+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:50:44.249294+0000","last_undegraded":"2023-06-23T18:50:44.249294+0000","last_fullsized":"2023-06-23T18:50:44.249294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.249097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:55.436409+0000","scrub_duration":0.0034108699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549923+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549923+0000","last_peered":"2023-06-23T18:49:41.549923+0000","last_clean":"2023-06-23T18:49:41.549923+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549923+0000","last_undegraded":"2023-06-23T18:49:41.549923+0000","last_fullsized":"2023-06-23T18:49:41.549923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:42.904789+0000","last_change":"2023-06-23T18:50:42.904856+0000","last_active":"2023-06-23T18:50:42.904789+0000","last_peered":"2023-06-23T18:50:42.904789+0000","last_clean":"2023-06-23T18:50:42.904789+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:50:42.904789+0000","last_undegraded":"2023-06-23T18:50:42.904789+0000","last_fullsized":"2023-06-23T18:50:42.904789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_clean_scrub_stamp":"2023-06-23T18:50:42.904670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:59.196272+0000","scrub_duration":0.001431545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.850052+0000","last_change":"2023-06-23T18:50:44.850145+0000","last_active":"2023-06-23T18:50:44.850052+0000","last_peered":"2023-06-23T18:50:44.850052+0000","last_clean":"2023-06-23T18:50:44.850052+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:50:44.850052+0000","last_undegraded":"2023-06-23T18:50:44.850052+0000","last_fullsized":"2023-06-23T18:50:44.850052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.849822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:57:45.611206+0000","scrub_duration":0.0040367679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175322+0000","last_change":"2023-06-23T18:49:36.810143+0000","last_active":"2023-06-23T18:49:41.175322+0000","last_peered":"2023-06-23T18:49:41.175322+0000","last_clean":"2023-06-23T18:49:41.175322+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:49:41.175322+0000","last_undegraded":"2023-06-23T18:49:41.175322+0000","last_fullsized":"2023-06-23T18:49:41.175322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.175913+0000","last_change":"2023-06-23T18:49:36.795056+0000","last_active":"2023-06-23T18:49:41.175913+0000","last_peered":"2023-06-23T18:49:41.175913+0000","last_clean":"2023-06-23T18:49:41.175913+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:49:41.175913+0000","last_undegraded":"2023-06-23T18:49:41.175913+0000","last_fullsized":"2023-06-23T18:49:41.175913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.176015+0000","last_change":"2023-06-23T18:49:36.787504+0000","last_active":"2023-06-23T18:49:41.176015+0000","last_peered":"2023-06-23T18:49:41.176015+0000","last_clean":"2023-06-23T18:49:41.176015+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:49:41.176015+0000","last_undegraded":"2023-06-23T18:49:41.176015+0000","last_fullsized":"2023-06-23T18:49:41.176015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554874+0000","last_change":"2023-06-23T18:49:36.816341+0000","last_active":"2023-06-23T18:49:41.554874+0000","last_peered":"2023-06-23T18:49:41.554874+0000","last_clean":"2023-06-23T18:49:41.554874+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:49:41.554874+0000","last_undegraded":"2023-06-23T18:49:41.554874+0000","last_fullsized":"2023-06-23T18:49:41.554874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547277+0000","last_change":"2023-06-23T18:49:36.797084+0000","last_active":"2023-06-23T18:49:41.547277+0000","last_peered":"2023-06-23T18:49:41.547277+0000","last_clean":"2023-06-23T18:49:41.547277+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:49:41.547277+0000","last_undegraded":"2023-06-23T18:49:41.547277+0000","last_fullsized":"2023-06-23T18:49:41.547277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6334,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.94099999999999995}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.111},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.84399999999999997}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.151}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0669999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.749},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":1.1830000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.1299999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.159},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2689999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.224},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.2450000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.04}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.62},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.95599999999999996}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.282},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.262}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.2230000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.196},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.077}]}]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.0069999999999999}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.081},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0469999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.234},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.171},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.3819999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.3240000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.91500000000000004}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.083}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0249999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.96399999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.044},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.077}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.012}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.101},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.96599999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.129}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.754},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.173}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.022}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.024},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.109}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.069}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0029999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.0469999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:51:04.961 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.962 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.962 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.963 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.963 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.963 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.964 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.964 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.964 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.964 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.965 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.965 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.965 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.966 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.966 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.966 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.967 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.967 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.967 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.968 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.968 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.968 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.968 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.969 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.969 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.969 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.970 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.970 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.970 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.971 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.971 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.971 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.971 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.972 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.972 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.972 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.973 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.973 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.973 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.974 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.974 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.974 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.974 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.975 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.975 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.975 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.976 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.976 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.976 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.977 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.977 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.977 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.977 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.978 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.978 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.978 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.979 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.979 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.979 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.979 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.980 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.980 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.980 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.981 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.981 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.981 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.982 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.982 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.982 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.982 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.983 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.983 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.983 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.984 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.984 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.984 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.985 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.985 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.985 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.985 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.986 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.986 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.986 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.987 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.987 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.987 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.987 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.988 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.988 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.988 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.989 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.989 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.989 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.990 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.990 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.990 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:04.990 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-23T18:51:23.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:23.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:23.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:23.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:23.467 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:24.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.114+0000 7f68d619a640 1 Processor -- start 2023-06-23T18:51:25.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.114+0000 7f68d619a640 1 -- start start 2023-06-23T18:51:25.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68d619a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 0x7f68d0070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68d619a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f68d00bc4f0 0x7f68d014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68d619a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d00b9ca0 con 0x7f68d00bd9b0 2023-06-23T18:51:25.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68d619a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00a55b0 con 0x7f68d00bc4f0 2023-06-23T18:51:25.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68d619a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00714a0 con 0x7f68d006c6d0 2023-06-23T18:51:25.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f68d00bc4f0 0x7f68d014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f68d00bc4f0 0x7f68d014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42692/0 (socket says 172.21.15.38:42692) 2023-06-23T18:51:25.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 -- 172.21.15.38:0/3922019082 learned_addr learned my addr 172.21.15.38:0/3922019082 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:51:25.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cf7fe640 1 --2- 172.21.15.38:0/3922019082 >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 0x7f68d0070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 -- 172.21.15.38:0/3922019082 >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 msgr2=0x7f68d0070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:51:25.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 --2- 172.21.15.38:0/3922019082 >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 0x7f68d0070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 -- 172.21.15.38:0/3922019082 >> v1:172.21.15.81:6789/0 conn(0x7f68d00bd9b0 legacy=0x7f68d00a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 -- 172.21.15.38:0/3922019082 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d006a3f0 con 0x7f68d00bc4f0 2023-06-23T18:51:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cf7fe640 1 --2- 172.21.15.38:0/3922019082 >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 0x7f68d0070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:51:25.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68cffff640 1 --2- 172.21.15.38:0/3922019082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d00bc4f0 0x7f68d014a4a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f68d006a6e0 tx=0x7f68c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9247bed1ff65004b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:25.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68ce7fc640 1 -- 172.21.15.38:0/3922019082 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00ab670 con 0x7f68d00bc4f0 2023-06-23T18:51:25.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68ce7fc640 1 -- 172.21.15.38:0/3922019082 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00ab7d0 con 0x7f68d00bc4f0 2023-06-23T18:51:25.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.118+0000 7f68ce7fc640 1 -- 172.21.15.38:0/3922019082 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00abb60 con 0x7f68d00bc4f0 2023-06-23T18:51:25.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/3922019082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d00bc4f0 msgr2=0x7f68d014a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- 172.21.15.38:0/3922019082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d00bc4f0 0x7f68d014a4a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f68d006a6e0 tx=0x7f68c001c470 comp rx=0 tx=0).stop 2023-06-23T18:51:25.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/3922019082 shutdown_connections 2023-06-23T18:51:25.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- 172.21.15.38:0/3922019082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d00bc4f0 0x7f68d014a4a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- 172.21.15.38:0/3922019082 >> v2:172.21.15.81:3300/0 conn(0x7f68d006c6d0 0x7f68d0070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/3922019082 >> 172.21.15.38:0/3922019082 conn(0x7f68d00c0c90 msgr2=0x7f68d00bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:25.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/3922019082 shutdown_connections 2023-06-23T18:51:25.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/3922019082 wait complete. 2023-06-23T18:51:25.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 Processor -- start 2023-06-23T18:51:25.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- start start 2023-06-23T18:51:25.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d00bc4f0 0x7f68d01e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f68d00bd9b0 0x7f68d01e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00bf370 con 0x7f68d006c6d0 2023-06-23T18:51:25.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0144760 con 0x7f68d00bc4f0 2023-06-23T18:51:25.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0144d20 con 0x7f68d00bd9b0 2023-06-23T18:51:25.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42694/0 (socket says 172.21.15.38:42694) 2023-06-23T18:51:25.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 -- 172.21.15.38:0/1713734696 learned_addr learned my addr 172.21.15.38:0/1713734696 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:51:25.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68ceffd640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d00bc4f0 0x7f68d01e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cffff640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f68d00bd9b0 0x7f68d01e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 -- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f68d00bd9b0 msgr2=0x7f68d01e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f68d00bd9b0 0x7f68d01e7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 -- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d00bc4f0 msgr2=0x7f68d01e7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d00bc4f0 0x7f68d01e7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 -- 172.21.15.38:0/1713734696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00094d0 con 0x7f68d006c6d0 2023-06-23T18:51:25.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68cf7fe640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007f20 tx=0x7f68c800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:25.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800dee0 con 0x7f68d006c6d0 2023-06-23T18:51:25.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800f040 con 0x7f68d006c6d0 2023-06-23T18:51:25.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d0143870 con 0x7f68d006c6d0 2023-06-23T18:51:25.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8003dc0 con 0x7f68d006c6d0 2023-06-23T18:51:25.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.122+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d01e8000 con 0x7f68d006c6d0 2023-06-23T18:51:25.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d004d790 con 0x7f68d006c6d0 2023-06-23T18:51:25.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68c8004030 con 0x7f68d006c6d0 2023-06-23T18:51:25.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68c7fff640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 0x7f68b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:25.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68c80841c0 con 0x7f68d006c6d0 2023-06-23T18:51:25.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68ceffd640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 0x7f68b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:25.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.126+0000 7f68ceffd640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 0x7f68b0068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68b8000f70 tx=0x7f68b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:25.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.130+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68c8051490 con 0x7f68d006c6d0 2023-06-23T18:51:25.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.278+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68d006caa0 con 0x7f68b0066280 2023-06-23T18:51:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.310+0000 7f68c7fff640 1 -- 172.21.15.38:0/1713734696 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390670 (secure 0 0 0) 0x7f68b8001370 con 0x7f68b0066280 2023-06-23T18:51:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:51:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:51:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 msgr2=0x7f68b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 0x7f68b0068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68b8000f70 tx=0x7f68b8009040 comp rx=0 tx=0).stop 2023-06-23T18:51:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 msgr2=0x7f68d0143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007f20 tx=0x7f68c800d560 comp rx=0 tx=0).stop 2023-06-23T18:51:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 shutdown_connections 2023-06-23T18:51:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f68b0066280 0x7f68b0068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f68d00bd9b0 0x7f68d01e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d00bc4f0 0x7f68d01e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 --2- 172.21.15.38:0/1713734696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68d006c6d0 0x7f68d0143330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 >> 172.21.15.38:0/1713734696 conn(0x7f68d00c0c90 msgr2=0x7f68d00a4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 shutdown_connections 2023-06-23T18:51:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:25.314+0000 7f68d619a640 1 -- 172.21.15.38:0/1713734696 wait complete. 2023-06-23T18:51:25.342 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-06-23T18:51:23.293668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596702,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":188,"ondisk_log_size":188,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740216,"statfs":{"total":773094113280,"available":772853981184,"internally_reserved":0,"allocated":2564096,"data_stored":2162460,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005999"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302331+0000","last_change":"2023-06-23T18:49:40.818200+0000","last_active":"2023-06-23T18:49:44.302331+0000","last_peered":"2023-06-23T18:49:44.302331+0000","last_clean":"2023-06-23T18:49:44.302331+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:49:44.302331+0000","last_undegraded":"2023-06-23T18:49:44.302331+0000","last_fullsized":"2023-06-23T18:49:44.302331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.630164+0000","last_change":"2023-06-23T18:51:01.630354+0000","last_active":"2023-06-23T18:51:01.630164+0000","last_peered":"2023-06-23T18:51:01.630164+0000","last_clean":"2023-06-23T18:51:01.630164+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:51:01.630164+0000","last_undegraded":"2023-06-23T18:51:01.630164+0000","last_fullsized":"2023-06-23T18:51:01.630164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.629955+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:47:56.036543+0000","scrub_duration":0.0081086479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean+scrubbing+deep","last_fresh":"2023-06-23T18:50:41.800558+0000","last_change":"2023-06-23T18:51:12.829249+0000","last_active":"2023-06-23T18:50:41.800558+0000","last_peered":"2023-06-23T18:50:41.800558+0000","last_clean":"2023-06-23T18:50:41.800558+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:50:41.800558+0000","last_undegraded":"2023-06-23T18:50:41.800558+0000","last_fullsized":"2023-06-23T18:50:41.800558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302169+0000","last_change":"2023-06-23T18:49:40.857169+0000","last_active":"2023-06-23T18:49:44.302169+0000","last_peered":"2023-06-23T18:49:44.302169+0000","last_clean":"2023-06-23T18:49:44.302169+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:49:44.302169+0000","last_undegraded":"2023-06-23T18:49:44.302169+0000","last_fullsized":"2023-06-23T18:49:44.302169+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.589809+0000","last_change":"2023-06-23T18:50:58.589921+0000","last_active":"2023-06-23T18:50:58.589809+0000","last_peered":"2023-06-23T18:50:58.589809+0000","last_clean":"2023-06-23T18:50:58.589809+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:50:58.589809+0000","last_undegraded":"2023-06-23T18:50:58.589809+0000","last_fullsized":"2023-06-23T18:50:58.589809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.589589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:39.052945+0000","scrub_duration":0.0036881570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.023838+0000","last_change":"2023-06-23T18:50:50.023931+0000","last_active":"2023-06-23T18:50:50.023838+0000","last_peered":"2023-06-23T18:50:50.023838+0000","last_clean":"2023-06-23T18:50:50.023838+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:50:50.023838+0000","last_undegraded":"2023-06-23T18:50:50.023838+0000","last_fullsized":"2023-06-23T18:50:50.023838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.023624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.888239+0000","scrub_duration":0.0031280280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303259+0000","last_change":"2023-06-23T18:49:40.823864+0000","last_active":"2023-06-23T18:49:44.303259+0000","last_peered":"2023-06-23T18:49:44.303259+0000","last_clean":"2023-06-23T18:49:44.303259+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:49:44.303259+0000","last_undegraded":"2023-06-23T18:49:44.303259+0000","last_fullsized":"2023-06-23T18:49:44.303259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.794729+0000","last_change":"2023-06-23T18:50:52.794857+0000","last_active":"2023-06-23T18:50:52.794729+0000","last_peered":"2023-06-23T18:50:52.794729+0000","last_clean":"2023-06-23T18:50:52.794729+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:50:52.794729+0000","last_undegraded":"2023-06-23T18:50:52.794729+0000","last_fullsized":"2023-06-23T18:50:52.794729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.794494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:15:53.603901+0000","scrub_duration":0.006501817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:00.074838+0000","last_change":"2023-06-23T18:51:00.074931+0000","last_active":"2023-06-23T18:51:00.074838+0000","last_peered":"2023-06-23T18:51:00.074838+0000","last_clean":"2023-06-23T18:51:00.074838+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:51:00.074838+0000","last_undegraded":"2023-06-23T18:51:00.074838+0000","last_fullsized":"2023-06-23T18:51:00.074838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:00.074635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:21.212875+0000","scrub_duration":0.003561402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302349+0000","last_change":"2023-06-23T18:49:40.856052+0000","last_active":"2023-06-23T18:49:44.302349+0000","last_peered":"2023-06-23T18:49:44.302349+0000","last_clean":"2023-06-23T18:49:44.302349+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:49:44.302349+0000","last_undegraded":"2023-06-23T18:49:44.302349+0000","last_fullsized":"2023-06-23T18:49:44.302349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.211877+0000","last_change":"2023-06-23T18:51:06.211982+0000","last_active":"2023-06-23T18:51:06.211877+0000","last_peered":"2023-06-23T18:51:06.211877+0000","last_clean":"2023-06-23T18:51:06.211877+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:51:06.211877+0000","last_undegraded":"2023-06-23T18:51:06.211877+0000","last_fullsized":"2023-06-23T18:51:06.211877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.211678+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:01.907622+0000","scrub_duration":0.0065308069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.905128+0000","last_change":"2023-06-23T18:51:17.905227+0000","last_active":"2023-06-23T18:51:17.905128+0000","last_peered":"2023-06-23T18:51:17.905128+0000","last_clean":"2023-06-23T18:51:17.905128+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:51:17.905128+0000","last_undegraded":"2023-06-23T18:51:17.905128+0000","last_fullsized":"2023-06-23T18:51:17.905128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.904924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:31.106614+0000","scrub_duration":0.0037596510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302616+0000","last_change":"2023-06-23T18:49:40.819558+0000","last_active":"2023-06-23T18:49:44.302616+0000","last_peered":"2023-06-23T18:49:44.302616+0000","last_clean":"2023-06-23T18:49:44.302616+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:49:44.302616+0000","last_undegraded":"2023-06-23T18:49:44.302616+0000","last_fullsized":"2023-06-23T18:49:44.302616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:11.933024+0000","last_change":"2023-06-23T18:51:11.933155+0000","last_active":"2023-06-23T18:51:11.933024+0000","last_peered":"2023-06-23T18:51:11.933024+0000","last_clean":"2023-06-23T18:51:11.933024+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:51:11.933024+0000","last_undegraded":"2023-06-23T18:51:11.933024+0000","last_fullsized":"2023-06-23T18:51:11.933024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_clean_scrub_stamp":"2023-06-23T18:51:11.932789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:49:12.124588+0000","scrub_duration":0.0036546809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.081975+0000","last_change":"2023-06-23T18:50:58.082067+0000","last_active":"2023-06-23T18:50:58.081975+0000","last_peered":"2023-06-23T18:50:58.081975+0000","last_clean":"2023-06-23T18:50:58.081975+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:50:58.081975+0000","last_undegraded":"2023-06-23T18:50:58.081975+0000","last_fullsized":"2023-06-23T18:50:58.081975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.081770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:15.215107+0000","scrub_duration":0.0035039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303315+0000","last_change":"2023-06-23T18:49:40.825769+0000","last_active":"2023-06-23T18:49:44.303315+0000","last_peered":"2023-06-23T18:49:44.303315+0000","last_clean":"2023-06-23T18:49:44.303315+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:49:44.303315+0000","last_undegraded":"2023-06-23T18:49:44.303315+0000","last_fullsized":"2023-06-23T18:49:44.303315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.266030+0000","last_change":"2023-06-23T18:51:01.266147+0000","last_active":"2023-06-23T18:51:01.266030+0000","last_peered":"2023-06-23T18:51:01.266030+0000","last_clean":"2023-06-23T18:51:01.266030+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:51:01.266030+0000","last_undegraded":"2023-06-23T18:51:01.266030+0000","last_fullsized":"2023-06-23T18:51:01.266030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.265826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:12.453139+0000","scrub_duration":0.0036297460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.027351+0000","last_change":"2023-06-23T18:51:16.027441+0000","last_active":"2023-06-23T18:51:16.027351+0000","last_peered":"2023-06-23T18:51:16.027351+0000","last_clean":"2023-06-23T18:51:16.027351+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:51:16.027351+0000","last_undegraded":"2023-06-23T18:51:16.027351+0000","last_fullsized":"2023-06-23T18:51:16.027351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.027155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.494549+0000","scrub_duration":0.0033927509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303433+0000","last_change":"2023-06-23T18:49:40.856909+0000","last_active":"2023-06-23T18:49:44.303433+0000","last_peered":"2023-06-23T18:49:44.303433+0000","last_clean":"2023-06-23T18:49:44.303433+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:49:44.303433+0000","last_undegraded":"2023-06-23T18:49:44.303433+0000","last_fullsized":"2023-06-23T18:49:44.303433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.078859+0000","last_change":"2023-06-23T18:51:02.078956+0000","last_active":"2023-06-23T18:51:02.078859+0000","last_peered":"2023-06-23T18:51:02.078859+0000","last_clean":"2023-06-23T18:51:02.078859+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:51:02.078859+0000","last_undegraded":"2023-06-23T18:51:02.078859+0000","last_fullsized":"2023-06-23T18:51:02.078859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.078635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:53:56.390687+0000","scrub_duration":0.003585436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.211395+0000","last_change":"2023-06-23T18:50:50.211554+0000","last_active":"2023-06-23T18:50:50.211395+0000","last_peered":"2023-06-23T18:50:50.211395+0000","last_clean":"2023-06-23T18:50:50.211395+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:50:50.211395+0000","last_undegraded":"2023-06-23T18:50:50.211395+0000","last_fullsized":"2023-06-23T18:50:50.211395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.211152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:38:55.024699+0000","scrub_duration":0.0034905040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.304053+0000","last_change":"2023-06-23T18:49:40.829713+0000","last_active":"2023-06-23T18:49:43.304053+0000","last_peered":"2023-06-23T18:49:43.304053+0000","last_clean":"2023-06-23T18:49:43.304053+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:49:43.304053+0000","last_undegraded":"2023-06-23T18:49:43.304053+0000","last_fullsized":"2023-06-23T18:49:43.304053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.521370+0000","last_change":"2023-06-23T18:50:53.521469+0000","last_active":"2023-06-23T18:50:53.521370+0000","last_peered":"2023-06-23T18:50:53.521370+0000","last_clean":"2023-06-23T18:50:53.521370+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:50:53.521370+0000","last_undegraded":"2023-06-23T18:50:53.521370+0000","last_fullsized":"2023-06-23T18:50:53.521370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.521154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:12:32.302169+0000","scrub_duration":0.0038767810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.834683+0000","last_change":"2023-06-23T18:50:55.834781+0000","last_active":"2023-06-23T18:50:55.834683+0000","last_peered":"2023-06-23T18:50:55.834683+0000","last_clean":"2023-06-23T18:50:55.834683+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:50:55.834683+0000","last_undegraded":"2023-06-23T18:50:55.834683+0000","last_fullsized":"2023-06-23T18:50:55.834683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.834438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:19:22.644409+0000","scrub_duration":0.0035002900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:13.025108+0000","last_change":"2023-06-23T18:51:13.025201+0000","last_active":"2023-06-23T18:51:13.025108+0000","last_peered":"2023-06-23T18:51:13.025108+0000","last_clean":"2023-06-23T18:51:13.025108+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:51:13.025108+0000","last_undegraded":"2023-06-23T18:51:13.025108+0000","last_fullsized":"2023-06-23T18:51:13.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_clean_scrub_stamp":"2023-06-23T18:51:13.024867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.212180+0000","scrub_duration":0.0034090629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.566433+0000","last_change":"2023-06-23T18:50:54.566595+0000","last_active":"2023-06-23T18:50:54.566433+0000","last_peered":"2023-06-23T18:50:54.566433+0000","last_clean":"2023-06-23T18:50:54.566433+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:50:54.566433+0000","last_undegraded":"2023-06-23T18:50:54.566433+0000","last_fullsized":"2023-06-23T18:50:54.566433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.566209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:15.460398+0000","scrub_duration":0.0040031069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.301913+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:44.301913+0000","last_peered":"2023-06-23T18:49:44.301913+0000","last_clean":"2023-06-23T18:49:44.301913+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:44.301913+0000","last_undegraded":"2023-06-23T18:49:44.301913+0000","last_fullsized":"2023-06-23T18:49:44.301913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.195109+0000","last_change":"2023-06-23T18:50:46.195216+0000","last_active":"2023-06-23T18:50:46.195109+0000","last_peered":"2023-06-23T18:50:46.195109+0000","last_clean":"2023-06-23T18:50:46.195109+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:50:46.195109+0000","last_undegraded":"2023-06-23T18:50:46.195109+0000","last_fullsized":"2023-06-23T18:50:46.195109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.194901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:05:11.372699+0000","scrub_duration":0.0039927290000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.242899+0000","last_change":"2023-06-23T18:50:44.242992+0000","last_active":"2023-06-23T18:50:44.242899+0000","last_peered":"2023-06-23T18:50:44.242899+0000","last_clean":"2023-06-23T18:50:44.242899+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:50:44.242899+0000","last_undegraded":"2023-06-23T18:50:44.242899+0000","last_fullsized":"2023-06-23T18:50:44.242899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.242702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:35.107318+0000","scrub_duration":0.0033288580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303098+0000","last_change":"2023-06-23T18:49:40.823120+0000","last_active":"2023-06-23T18:49:44.303098+0000","last_peered":"2023-06-23T18:49:44.303098+0000","last_clean":"2023-06-23T18:49:44.303098+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:49:44.303098+0000","last_undegraded":"2023-06-23T18:49:44.303098+0000","last_fullsized":"2023-06-23T18:49:44.303098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.922718+0000","last_change":"2023-06-23T18:50:52.922831+0000","last_active":"2023-06-23T18:50:52.922718+0000","last_peered":"2023-06-23T18:50:52.922718+0000","last_clean":"2023-06-23T18:50:52.922718+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:50:52.922718+0000","last_undegraded":"2023-06-23T18:50:52.922718+0000","last_fullsized":"2023-06-23T18:50:52.922718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.922501+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.034066+0000","scrub_duration":0.0078325200000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.236438+0000","last_change":"2023-06-23T18:50:47.236534+0000","last_active":"2023-06-23T18:50:47.236438+0000","last_peered":"2023-06-23T18:50:47.236438+0000","last_clean":"2023-06-23T18:50:47.236438+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:50:47.236438+0000","last_undegraded":"2023-06-23T18:50:47.236438+0000","last_fullsized":"2023-06-23T18:50:47.236438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.236189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:23.521561+0000","scrub_duration":0.003811432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302501+0000","last_change":"2023-06-23T18:49:40.830894+0000","last_active":"2023-06-23T18:49:44.302501+0000","last_peered":"2023-06-23T18:49:44.302501+0000","last_clean":"2023-06-23T18:49:44.302501+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:49:44.302501+0000","last_undegraded":"2023-06-23T18:49:44.302501+0000","last_fullsized":"2023-06-23T18:49:44.302501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.706754+0000","last_change":"2023-06-23T18:51:04.706830+0000","last_active":"2023-06-23T18:51:04.706754+0000","last_peered":"2023-06-23T18:51:04.706754+0000","last_clean":"2023-06-23T18:51:04.706754+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:51:04.706754+0000","last_undegraded":"2023-06-23T18:51:04.706754+0000","last_fullsized":"2023-06-23T18:51:04.706754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.706637+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:31:56.591587+0000","scrub_duration":0.0056771579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.030649+0000","last_change":"2023-06-23T18:51:02.030740+0000","last_active":"2023-06-23T18:51:02.030649+0000","last_peered":"2023-06-23T18:51:02.030649+0000","last_clean":"2023-06-23T18:51:02.030649+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:51:02.030649+0000","last_undegraded":"2023-06-23T18:51:02.030649+0000","last_fullsized":"2023-06-23T18:51:02.030649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.030409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:05.583835+0000","scrub_duration":0.00380671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303905+0000","last_change":"2023-06-23T18:49:40.841276+0000","last_active":"2023-06-23T18:49:43.303905+0000","last_peered":"2023-06-23T18:49:43.303905+0000","last_clean":"2023-06-23T18:49:43.303905+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:49:43.303905+0000","last_undegraded":"2023-06-23T18:49:43.303905+0000","last_fullsized":"2023-06-23T18:49:43.303905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.939964+0000","last_change":"2023-06-23T18:51:07.940123+0000","last_active":"2023-06-23T18:51:07.939964+0000","last_peered":"2023-06-23T18:51:07.939964+0000","last_clean":"2023-06-23T18:51:07.939964+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:51:07.939964+0000","last_undegraded":"2023-06-23T18:51:07.939964+0000","last_fullsized":"2023-06-23T18:51:07.939964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.939690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:19.127003+0000","scrub_duration":0.0034629029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.555000+0000","last_change":"2023-06-23T18:49:32.326154+0000","last_active":"2023-06-23T18:49:41.555000+0000","last_peered":"2023-06-23T18:49:41.555000+0000","last_clean":"2023-06-23T18:49:41.555000+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:49:41.555000+0000","last_undegraded":"2023-06-23T18:49:41.555000+0000","last_fullsized":"2023-06-23T18:49:41.555000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:31.295542+0000","last_clean_scrub_stamp":"2023-06-23T18:49:31.295542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:05.937651+0000","last_change":"2023-06-23T18:51:05.937842+0000","last_active":"2023-06-23T18:51:05.937651+0000","last_peered":"2023-06-23T18:51:05.937651+0000","last_clean":"2023-06-23T18:51:05.937651+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:51:05.937651+0000","last_undegraded":"2023-06-23T18:51:05.937651+0000","last_fullsized":"2023-06-23T18:51:05.937651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_clean_scrub_stamp":"2023-06-23T18:51:05.937431+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:08:40.956719+0000","scrub_duration":0.006516399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302221+0000","last_change":"2023-06-23T18:49:40.819591+0000","last_active":"2023-06-23T18:49:44.302221+0000","last_peered":"2023-06-23T18:49:44.302221+0000","last_clean":"2023-06-23T18:49:44.302221+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:49:44.302221+0000","last_undegraded":"2023-06-23T18:49:44.302221+0000","last_fullsized":"2023-06-23T18:49:44.302221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.859730+0000","last_change":"2023-06-23T18:51:15.859824+0000","last_active":"2023-06-23T18:51:15.859730+0000","last_peered":"2023-06-23T18:51:15.859730+0000","last_clean":"2023-06-23T18:51:15.859730+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:51:15.859730+0000","last_undegraded":"2023-06-23T18:51:15.859730+0000","last_fullsized":"2023-06-23T18:51:15.859730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.859533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:16:16.668940+0000","scrub_duration":0.0038012860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.108882+0000","last_change":"2023-06-23T18:51:01.108971+0000","last_active":"2023-06-23T18:51:01.108882+0000","last_peered":"2023-06-23T18:51:01.108882+0000","last_clean":"2023-06-23T18:51:01.108882+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:51:01.108882+0000","last_undegraded":"2023-06-23T18:51:01.108882+0000","last_fullsized":"2023-06-23T18:51:01.108882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.108678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:49:59.724785+0000","scrub_duration":0.0037045720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.973326+0000","last_change":"2023-06-23T18:51:07.973434+0000","last_active":"2023-06-23T18:51:07.973326+0000","last_peered":"2023-06-23T18:51:07.973326+0000","last_clean":"2023-06-23T18:51:07.973326+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:51:07.973326+0000","last_undegraded":"2023-06-23T18:51:07.973326+0000","last_fullsized":"2023-06-23T18:51:07.973326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.973139+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:58:08.734523+0000","scrub_duration":0.0064564239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.301946+0000","last_change":"2023-06-23T18:49:40.819326+0000","last_active":"2023-06-23T18:49:44.301946+0000","last_peered":"2023-06-23T18:49:44.301946+0000","last_clean":"2023-06-23T18:49:44.301946+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:49:44.301946+0000","last_undegraded":"2023-06-23T18:49:44.301946+0000","last_fullsized":"2023-06-23T18:49:44.301946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547464+0000","last_change":"2023-06-23T18:49:36.780855+0000","last_active":"2023-06-23T18:49:41.547464+0000","last_peered":"2023-06-23T18:49:41.547464+0000","last_clean":"2023-06-23T18:49:41.547464+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:49:41.547464+0000","last_undegraded":"2023-06-23T18:49:41.547464+0000","last_fullsized":"2023-06-23T18:49:41.547464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.727602+0000","last_change":"2023-06-23T18:51:16.727701+0000","last_active":"2023-06-23T18:51:16.727602+0000","last_peered":"2023-06-23T18:51:16.727602+0000","last_clean":"2023-06-23T18:51:16.727602+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:51:16.727602+0000","last_undegraded":"2023-06-23T18:51:16.727602+0000","last_fullsized":"2023-06-23T18:51:16.727602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.727396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:21.123261+0000","scrub_duration":0.0036014829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.492419+0000","last_change":"2023-06-23T18:50:49.492510+0000","last_active":"2023-06-23T18:50:49.492419+0000","last_peered":"2023-06-23T18:50:49.492419+0000","last_clean":"2023-06-23T18:50:49.492419+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:50:49.492419+0000","last_undegraded":"2023-06-23T18:50:49.492419+0000","last_fullsized":"2023-06-23T18:50:49.492419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.492191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:08:58.030503+0000","scrub_duration":0.003101272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303173+0000","last_change":"2023-06-23T18:49:40.856234+0000","last_active":"2023-06-23T18:49:44.303173+0000","last_peered":"2023-06-23T18:49:44.303173+0000","last_clean":"2023-06-23T18:49:44.303173+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:49:44.303173+0000","last_undegraded":"2023-06-23T18:49:44.303173+0000","last_fullsized":"2023-06-23T18:49:44.303173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.518585+0000","last_change":"2023-06-23T18:51:12.518698+0000","last_active":"2023-06-23T18:51:12.518585+0000","last_peered":"2023-06-23T18:51:12.518585+0000","last_clean":"2023-06-23T18:51:12.518585+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:51:12.518585+0000","last_undegraded":"2023-06-23T18:51:12.518585+0000","last_fullsized":"2023-06-23T18:51:12.518585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.518378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:23.705690+0000","scrub_duration":0.003859594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.534098+0000","last_change":"2023-06-23T18:50:52.534195+0000","last_active":"2023-06-23T18:50:52.534098+0000","last_peered":"2023-06-23T18:50:52.534098+0000","last_clean":"2023-06-23T18:50:52.534098+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:50:52.534098+0000","last_undegraded":"2023-06-23T18:50:52.534098+0000","last_fullsized":"2023-06-23T18:50:52.534098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.533877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:49.679167+0000","scrub_duration":0.0032420919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:43.232613+0000","last_change":"2023-06-23T18:50:43.232656+0000","last_active":"2023-06-23T18:50:43.232613+0000","last_peered":"2023-06-23T18:50:43.232613+0000","last_clean":"2023-06-23T18:50:43.232613+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:50:43.232613+0000","last_undegraded":"2023-06-23T18:50:43.232613+0000","last_fullsized":"2023-06-23T18:50:43.232613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_clean_scrub_stamp":"2023-06-23T18:50:43.232516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:25.567882+0000","scrub_duration":0.0029476870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302527+0000","last_change":"2023-06-23T18:49:40.827180+0000","last_active":"2023-06-23T18:49:44.302527+0000","last_peered":"2023-06-23T18:49:44.302527+0000","last_clean":"2023-06-23T18:49:44.302527+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:49:44.302527+0000","last_undegraded":"2023-06-23T18:49:44.302527+0000","last_fullsized":"2023-06-23T18:49:44.302527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.497234+0000","last_change":"2023-06-23T18:51:06.497325+0000","last_active":"2023-06-23T18:51:06.497234+0000","last_peered":"2023-06-23T18:51:06.497234+0000","last_clean":"2023-06-23T18:51:06.497234+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:51:06.497234+0000","last_undegraded":"2023-06-23T18:51:06.497234+0000","last_fullsized":"2023-06-23T18:51:06.497234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.497010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.050436+0000","scrub_duration":0.003339449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:45.885459+0000","last_change":"2023-06-23T18:50:45.885555+0000","last_active":"2023-06-23T18:50:45.885459+0000","last_peered":"2023-06-23T18:50:45.885459+0000","last_clean":"2023-06-23T18:50:45.885459+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:50:45.885459+0000","last_undegraded":"2023-06-23T18:50:45.885459+0000","last_fullsized":"2023-06-23T18:50:45.885459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_clean_scrub_stamp":"2023-06-23T18:50:45.885234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.476258+0000","scrub_duration":0.0032745949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.725498+0000","last_change":"2023-06-23T18:51:18.725601+0000","last_active":"2023-06-23T18:51:18.725498+0000","last_peered":"2023-06-23T18:51:18.725498+0000","last_clean":"2023-06-23T18:51:18.725498+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:51:18.725498+0000","last_undegraded":"2023-06-23T18:51:18.725498+0000","last_fullsized":"2023-06-23T18:51:18.725498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.725283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:21:09.554309+0000","scrub_duration":0.0038159040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302131+0000","last_change":"2023-06-23T18:49:40.841571+0000","last_active":"2023-06-23T18:49:44.302131+0000","last_peered":"2023-06-23T18:49:44.302131+0000","last_clean":"2023-06-23T18:49:44.302131+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:49:44.302131+0000","last_undegraded":"2023-06-23T18:49:44.302131+0000","last_fullsized":"2023-06-23T18:49:44.302131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.527616+0000","last_change":"2023-06-23T18:51:17.527707+0000","last_active":"2023-06-23T18:51:17.527616+0000","last_peered":"2023-06-23T18:51:17.527616+0000","last_clean":"2023-06-23T18:51:17.527616+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:51:17.527616+0000","last_undegraded":"2023-06-23T18:51:17.527616+0000","last_fullsized":"2023-06-23T18:51:17.527616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.527411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.223355+0000","scrub_duration":0.0037119330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:59.619803+0000","last_change":"2023-06-23T18:50:59.619897+0000","last_active":"2023-06-23T18:50:59.619803+0000","last_peered":"2023-06-23T18:50:59.619803+0000","last_clean":"2023-06-23T18:50:59.619803+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:50:59.619803+0000","last_undegraded":"2023-06-23T18:50:59.619803+0000","last_fullsized":"2023-06-23T18:50:59.619803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_clean_scrub_stamp":"2023-06-23T18:50:59.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:40:36.386104+0000","scrub_duration":0.0065439850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.029209+0000","last_change":"2023-06-23T18:50:46.029369+0000","last_active":"2023-06-23T18:50:46.029209+0000","last_peered":"2023-06-23T18:50:46.029209+0000","last_clean":"2023-06-23T18:50:46.029209+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:50:46.029209+0000","last_undegraded":"2023-06-23T18:50:46.029209+0000","last_fullsized":"2023-06-23T18:50:46.029209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.028949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.619973+0000","scrub_duration":0.0030831489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302209+0000","last_change":"2023-06-23T18:49:40.822481+0000","last_active":"2023-06-23T18:49:44.302209+0000","last_peered":"2023-06-23T18:49:44.302209+0000","last_clean":"2023-06-23T18:49:44.302209+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:49:44.302209+0000","last_undegraded":"2023-06-23T18:49:44.302209+0000","last_fullsized":"2023-06-23T18:49:44.302209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.547031+0000","last_change":"2023-06-23T18:49:36.791506+0000","last_active":"2023-06-23T18:49:41.547031+0000","last_peered":"2023-06-23T18:49:41.547031+0000","last_clean":"2023-06-23T18:49:41.547031+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:49:41.547031+0000","last_undegraded":"2023-06-23T18:49:41.547031+0000","last_fullsized":"2023-06-23T18:49:41.547031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.504742+0000","last_change":"2023-06-23T18:50:50.504828+0000","last_active":"2023-06-23T18:50:50.504742+0000","last_peered":"2023-06-23T18:50:50.504742+0000","last_clean":"2023-06-23T18:50:50.504742+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:50:50.504742+0000","last_undegraded":"2023-06-23T18:50:50.504742+0000","last_fullsized":"2023-06-23T18:50:50.504742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.504552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:37.616116+0000","scrub_duration":0.0037428470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.681218+0000","last_change":"2023-06-23T18:51:12.681337+0000","last_active":"2023-06-23T18:51:12.681218+0000","last_peered":"2023-06-23T18:51:12.681218+0000","last_clean":"2023-06-23T18:51:12.681218+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:51:12.681218+0000","last_undegraded":"2023-06-23T18:51:12.681218+0000","last_fullsized":"2023-06-23T18:51:12.681218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.681001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:33.106167+0000","scrub_duration":0.0069918799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302358+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:44.302358+0000","last_peered":"2023-06-23T18:49:44.302358+0000","last_clean":"2023-06-23T18:49:44.302358+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:44.302358+0000","last_undegraded":"2023-06-23T18:49:44.302358+0000","last_fullsized":"2023-06-23T18:49:44.302358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554487+0000","last_change":"2023-06-23T18:49:36.772594+0000","last_active":"2023-06-23T18:49:41.554487+0000","last_peered":"2023-06-23T18:49:41.554487+0000","last_clean":"2023-06-23T18:49:41.554487+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:49:41.554487+0000","last_undegraded":"2023-06-23T18:49:41.554487+0000","last_fullsized":"2023-06-23T18:49:41.554487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.877644+0000","last_change":"2023-06-23T18:51:14.877755+0000","last_active":"2023-06-23T18:51:14.877644+0000","last_peered":"2023-06-23T18:51:14.877644+0000","last_clean":"2023-06-23T18:51:14.877644+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:51:14.877644+0000","last_undegraded":"2023-06-23T18:51:14.877644+0000","last_fullsized":"2023-06-23T18:51:14.877644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.877419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:02.034083+0000","scrub_duration":0.00389647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.698668+0000","last_change":"2023-06-23T18:51:10.698763+0000","last_active":"2023-06-23T18:51:10.698668+0000","last_peered":"2023-06-23T18:51:10.698668+0000","last_clean":"2023-06-23T18:51:10.698668+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:51:10.698668+0000","last_undegraded":"2023-06-23T18:51:10.698668+0000","last_fullsized":"2023-06-23T18:51:10.698668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.698412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:37:53.107746+0000","scrub_duration":0.0035457790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.397361+0000","last_change":"2023-06-23T18:50:55.397477+0000","last_active":"2023-06-23T18:50:55.397361+0000","last_peered":"2023-06-23T18:50:55.397361+0000","last_clean":"2023-06-23T18:50:55.397361+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:50:55.397361+0000","last_undegraded":"2023-06-23T18:50:55.397361+0000","last_fullsized":"2023-06-23T18:50:55.397361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.397147+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:51:58.950573+0000","scrub_duration":0.013609326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.303250+0000","last_change":"2023-06-23T18:49:40.835663+0000","last_active":"2023-06-23T18:49:44.303250+0000","last_peered":"2023-06-23T18:49:44.303250+0000","last_clean":"2023-06-23T18:49:44.303250+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:49:44.303250+0000","last_undegraded":"2023-06-23T18:49:44.303250+0000","last_fullsized":"2023-06-23T18:49:44.303250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.885176+0000","last_change":"2023-06-23T18:51:06.885266+0000","last_active":"2023-06-23T18:51:06.885176+0000","last_peered":"2023-06-23T18:51:06.885176+0000","last_clean":"2023-06-23T18:51:06.885176+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:51:06.885176+0000","last_undegraded":"2023-06-23T18:51:06.885176+0000","last_fullsized":"2023-06-23T18:51:06.885176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.884967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.438393+0000","scrub_duration":0.0029774070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.025578+0000","last_change":"2023-06-23T18:51:04.025678+0000","last_active":"2023-06-23T18:51:04.025578+0000","last_peered":"2023-06-23T18:51:04.025578+0000","last_clean":"2023-06-23T18:51:04.025578+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:51:04.025578+0000","last_undegraded":"2023-06-23T18:51:04.025578+0000","last_fullsized":"2023-06-23T18:51:04.025578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.025376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:14:45.646151+0000","scrub_duration":0.0033227130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302329+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:44.302329+0000","last_peered":"2023-06-23T18:49:44.302329+0000","last_clean":"2023-06-23T18:49:44.302329+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:44.302329+0000","last_undegraded":"2023-06-23T18:49:44.302329+0000","last_fullsized":"2023-06-23T18:49:44.302329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.846376+0000","last_change":"2023-06-23T18:51:10.846543+0000","last_active":"2023-06-23T18:51:10.846376+0000","last_peered":"2023-06-23T18:51:10.846376+0000","last_clean":"2023-06-23T18:51:10.846376+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:51:10.846376+0000","last_undegraded":"2023-06-23T18:51:10.846376+0000","last_fullsized":"2023-06-23T18:51:10.846376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.846070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:57.313464+0000","scrub_duration":0.003130163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552241+0000","last_change":"2023-06-23T18:49:36.393781+0000","last_active":"2023-06-23T18:49:41.552241+0000","last_peered":"2023-06-23T18:49:41.552241+0000","last_clean":"2023-06-23T18:49:41.552241+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:49:41.552241+0000","last_undegraded":"2023-06-23T18:49:41.552241+0000","last_fullsized":"2023-06-23T18:49:41.552241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302491+0000","last_change":"2023-06-23T18:49:40.857465+0000","last_active":"2023-06-23T18:49:44.302491+0000","last_peered":"2023-06-23T18:49:44.302491+0000","last_clean":"2023-06-23T18:49:44.302491+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:49:44.302491+0000","last_undegraded":"2023-06-23T18:49:44.302491+0000","last_fullsized":"2023-06-23T18:49:44.302491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.797511+0000","last_change":"2023-06-23T18:50:50.797602+0000","last_active":"2023-06-23T18:50:50.797511+0000","last_peered":"2023-06-23T18:50:50.797511+0000","last_clean":"2023-06-23T18:50:50.797511+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:50:50.797511+0000","last_undegraded":"2023-06-23T18:50:50.797511+0000","last_fullsized":"2023-06-23T18:50:50.797511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.797299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:30:37.953962+0000","scrub_duration":0.0033459710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.784633+0000","last_change":"2023-06-23T18:50:58.784725+0000","last_active":"2023-06-23T18:50:58.784633+0000","last_peered":"2023-06-23T18:50:58.784633+0000","last_clean":"2023-06-23T18:50:58.784633+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:50:58.784633+0000","last_undegraded":"2023-06-23T18:50:58.784633+0000","last_fullsized":"2023-06-23T18:50:58.784633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.784419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:02.814290+0000","scrub_duration":0.0033385580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:42.296160+0000","last_change":"2023-06-23T18:49:40.845053+0000","last_active":"2023-06-23T18:49:42.296160+0000","last_peered":"2023-06-23T18:49:42.296160+0000","last_clean":"2023-06-23T18:49:42.296160+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:49:42.296160+0000","last_undegraded":"2023-06-23T18:49:42.296160+0000","last_fullsized":"2023-06-23T18:49:42.296160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.830793+0000","last_change":"2023-06-23T18:51:12.830893+0000","last_active":"2023-06-23T18:51:12.830793+0000","last_peered":"2023-06-23T18:51:12.830793+0000","last_clean":"2023-06-23T18:51:12.830793+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:51:12.830793+0000","last_undegraded":"2023-06-23T18:51:12.830793+0000","last_fullsized":"2023-06-23T18:51:12.830793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.830505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.017818+0000","scrub_duration":0.003381111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.058715+0000","last_change":"2023-06-23T18:50:49.058838+0000","last_active":"2023-06-23T18:50:49.058715+0000","last_peered":"2023-06-23T18:50:49.058715+0000","last_clean":"2023-06-23T18:50:49.058715+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:50:49.058715+0000","last_undegraded":"2023-06-23T18:50:49.058715+0000","last_fullsized":"2023-06-23T18:50:49.058715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.058507+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.393874+0000","scrub_duration":0.0062727069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.063112+0000","last_change":"2023-06-23T18:51:18.063242+0000","last_active":"2023-06-23T18:51:18.063112+0000","last_peered":"2023-06-23T18:51:18.063112+0000","last_clean":"2023-06-23T18:51:18.063112+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:51:18.063112+0000","last_undegraded":"2023-06-23T18:51:18.063112+0000","last_fullsized":"2023-06-23T18:51:18.063112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.062909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.758852+0000","scrub_duration":0.0036211770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.658267+0000","last_change":"2023-06-23T18:51:02.658426+0000","last_active":"2023-06-23T18:51:02.658267+0000","last_peered":"2023-06-23T18:51:02.658267+0000","last_clean":"2023-06-23T18:51:02.658267+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:51:02.658267+0000","last_undegraded":"2023-06-23T18:51:02.658267+0000","last_fullsized":"2023-06-23T18:51:02.658267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.657999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:30:45.392084+0000","scrub_duration":0.0031540729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:48.953800+0000","last_change":"2023-06-23T18:50:48.953903+0000","last_active":"2023-06-23T18:50:48.953800+0000","last_peered":"2023-06-23T18:50:48.953800+0000","last_clean":"2023-06-23T18:50:48.953800+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:50:48.953800+0000","last_undegraded":"2023-06-23T18:50:48.953800+0000","last_fullsized":"2023-06-23T18:50:48.953800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_clean_scrub_stamp":"2023-06-23T18:50:48.953602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.288968+0000","scrub_duration":0.0038302459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303934+0000","last_change":"2023-06-23T18:49:40.843819+0000","last_active":"2023-06-23T18:49:43.303934+0000","last_peered":"2023-06-23T18:49:43.303934+0000","last_clean":"2023-06-23T18:49:43.303934+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:49:43.303934+0000","last_undegraded":"2023-06-23T18:49:43.303934+0000","last_fullsized":"2023-06-23T18:49:43.303934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.550645+0000","last_change":"2023-06-23T18:49:36.770066+0000","last_active":"2023-06-23T18:49:41.550645+0000","last_peered":"2023-06-23T18:49:41.550645+0000","last_clean":"2023-06-23T18:49:41.550645+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:49:41.550645+0000","last_undegraded":"2023-06-23T18:49:41.550645+0000","last_fullsized":"2023-06-23T18:49:41.550645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.805977+0000","last_change":"2023-06-23T18:50:54.806099+0000","last_active":"2023-06-23T18:50:54.805977+0000","last_peered":"2023-06-23T18:50:54.805977+0000","last_clean":"2023-06-23T18:50:54.805977+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:50:54.805977+0000","last_undegraded":"2023-06-23T18:50:54.805977+0000","last_fullsized":"2023-06-23T18:50:54.805977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.805774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:15:14.043224+0000","scrub_duration":0.0073158950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:42.296051+0000","last_change":"2023-06-23T18:49:40.850553+0000","last_active":"2023-06-23T18:49:42.296051+0000","last_peered":"2023-06-23T18:49:42.296051+0000","last_clean":"2023-06-23T18:49:42.296051+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:49:42.296051+0000","last_undegraded":"2023-06-23T18:49:42.296051+0000","last_fullsized":"2023-06-23T18:49:42.296051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.158176+0000","last_change":"2023-06-23T18:51:10.158286+0000","last_active":"2023-06-23T18:51:10.158176+0000","last_peered":"2023-06-23T18:51:10.158176+0000","last_clean":"2023-06-23T18:51:10.158176+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:51:10.158176+0000","last_undegraded":"2023-06-23T18:51:10.158176+0000","last_fullsized":"2023-06-23T18:51:10.158176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.157958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:23.359647+0000","scrub_duration":0.0038438600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.262886+0000","last_change":"2023-06-23T18:50:47.263007+0000","last_active":"2023-06-23T18:50:47.262886+0000","last_peered":"2023-06-23T18:50:47.262886+0000","last_clean":"2023-06-23T18:50:47.262886+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:50:47.262886+0000","last_undegraded":"2023-06-23T18:50:47.262886+0000","last_fullsized":"2023-06-23T18:50:47.262886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.262681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:34.374245+0000","scrub_duration":0.0065258790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:43.303836+0000","last_change":"2023-06-23T18:49:40.842273+0000","last_active":"2023-06-23T18:49:43.303836+0000","last_peered":"2023-06-23T18:49:43.303836+0000","last_clean":"2023-06-23T18:49:43.303836+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:49:43.303836+0000","last_undegraded":"2023-06-23T18:49:43.303836+0000","last_fullsized":"2023-06-23T18:49:43.303836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.764785+0000","last_change":"2023-06-23T18:51:01.764888+0000","last_active":"2023-06-23T18:51:01.764785+0000","last_peered":"2023-06-23T18:51:01.764785+0000","last_clean":"2023-06-23T18:51:01.764785+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:51:01.764785+0000","last_undegraded":"2023-06-23T18:51:01.764785+0000","last_fullsized":"2023-06-23T18:51:01.764785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.764540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:02.584944+0000","scrub_duration":0.0032137759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.000041+0000","last_change":"2023-06-23T18:50:50.000146+0000","last_active":"2023-06-23T18:50:50.000041+0000","last_peered":"2023-06-23T18:50:50.000041+0000","last_clean":"2023-06-23T18:50:50.000041+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:50:50.000041+0000","last_undegraded":"2023-06-23T18:50:50.000041+0000","last_fullsized":"2023-06-23T18:50:50.000041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.999846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.864462+0000","scrub_duration":0.0065858610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302299+0000","last_change":"2023-06-23T18:49:40.834232+0000","last_active":"2023-06-23T18:49:44.302299+0000","last_peered":"2023-06-23T18:49:44.302299+0000","last_clean":"2023-06-23T18:49:44.302299+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:49:44.302299+0000","last_undegraded":"2023-06-23T18:49:44.302299+0000","last_fullsized":"2023-06-23T18:49:44.302299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302301+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:44.302301+0000","last_peered":"2023-06-23T18:49:44.302301+0000","last_clean":"2023-06-23T18:49:44.302301+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:44.302301+0000","last_undegraded":"2023-06-23T18:49:44.302301+0000","last_fullsized":"2023-06-23T18:49:44.302301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.261437+0000","last_change":"2023-06-23T18:51:04.261620+0000","last_active":"2023-06-23T18:51:04.261437+0000","last_peered":"2023-06-23T18:51:04.261437+0000","last_clean":"2023-06-23T18:51:04.261437+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:51:04.261437+0000","last_undegraded":"2023-06-23T18:51:04.261437+0000","last_fullsized":"2023-06-23T18:51:04.261437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.261136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:50.728530+0000","scrub_duration":0.011066975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.546822+0000","last_change":"2023-06-23T18:49:36.795384+0000","last_active":"2023-06-23T18:49:41.546822+0000","last_peered":"2023-06-23T18:49:41.546822+0000","last_clean":"2023-06-23T18:49:41.546822+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:49:41.546822+0000","last_undegraded":"2023-06-23T18:49:41.546822+0000","last_fullsized":"2023-06-23T18:49:41.546822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302695+0000","last_change":"2023-06-23T18:49:40.850621+0000","last_active":"2023-06-23T18:49:44.302695+0000","last_peered":"2023-06-23T18:49:44.302695+0000","last_clean":"2023-06-23T18:49:44.302695+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:49:44.302695+0000","last_undegraded":"2023-06-23T18:49:44.302695+0000","last_fullsized":"2023-06-23T18:49:44.302695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552133+0000","last_change":"2023-06-23T18:49:36.387250+0000","last_active":"2023-06-23T18:49:41.552133+0000","last_peered":"2023-06-23T18:49:41.552133+0000","last_clean":"2023-06-23T18:49:41.552133+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:49:41.552133+0000","last_undegraded":"2023-06-23T18:49:41.552133+0000","last_fullsized":"2023-06-23T18:49:41.552133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.409783+0000","last_change":"2023-06-23T18:51:19.409871+0000","last_active":"2023-06-23T18:51:19.409783+0000","last_peered":"2023-06-23T18:51:19.409783+0000","last_clean":"2023-06-23T18:51:19.409783+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:51:19.409783+0000","last_undegraded":"2023-06-23T18:51:19.409783+0000","last_fullsized":"2023-06-23T18:51:19.409783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.409589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:58:04.291439+0000","scrub_duration":0.0031584650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.502252+0000","last_change":"2023-06-23T18:50:47.502356+0000","last_active":"2023-06-23T18:50:47.502252+0000","last_peered":"2023-06-23T18:50:47.502252+0000","last_clean":"2023-06-23T18:50:47.502252+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:50:47.502252+0000","last_undegraded":"2023-06-23T18:50:47.502252+0000","last_fullsized":"2023-06-23T18:50:47.502252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.502043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:29.837409+0000","scrub_duration":0.0040377850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.792097+0000","last_change":"2023-06-23T18:50:53.792192+0000","last_active":"2023-06-23T18:50:53.792097+0000","last_peered":"2023-06-23T18:50:53.792097+0000","last_clean":"2023-06-23T18:50:53.792097+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:50:53.792097+0000","last_undegraded":"2023-06-23T18:50:53.792097+0000","last_fullsized":"2023-06-23T18:50:53.792097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.791890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:31.408545+0000","scrub_duration":0.0032528520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302578+0000","last_change":"2023-06-23T18:49:40.836250+0000","last_active":"2023-06-23T18:49:44.302578+0000","last_peered":"2023-06-23T18:49:44.302578+0000","last_clean":"2023-06-23T18:49:44.302578+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:49:44.302578+0000","last_undegraded":"2023-06-23T18:49:44.302578+0000","last_fullsized":"2023-06-23T18:49:44.302578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.552922+0000","last_change":"2023-06-23T18:49:36.396771+0000","last_active":"2023-06-23T18:49:41.552922+0000","last_peered":"2023-06-23T18:49:41.552922+0000","last_clean":"2023-06-23T18:49:41.552922+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:49:41.552922+0000","last_undegraded":"2023-06-23T18:49:41.552922+0000","last_fullsized":"2023-06-23T18:49:41.552922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:35.338027+0000","last_clean_scrub_stamp":"2023-06-23T18:49:35.338027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.522782+0000","last_change":"2023-06-23T18:51:15.522875+0000","last_active":"2023-06-23T18:51:15.522782+0000","last_peered":"2023-06-23T18:51:15.522782+0000","last_clean":"2023-06-23T18:51:15.522782+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:51:15.522782+0000","last_undegraded":"2023-06-23T18:51:15.522782+0000","last_fullsized":"2023-06-23T18:51:15.522782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.522580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:01.989974+0000","scrub_duration":0.0030724910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302111+0000","last_change":"2023-06-23T18:49:40.845683+0000","last_active":"2023-06-23T18:49:44.302111+0000","last_peered":"2023-06-23T18:49:44.302111+0000","last_clean":"2023-06-23T18:49:44.302111+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:49:44.302111+0000","last_undegraded":"2023-06-23T18:49:44.302111+0000","last_fullsized":"2023-06-23T18:49:44.302111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.142526+0000","last_change":"2023-06-23T18:51:15.142650+0000","last_active":"2023-06-23T18:51:15.142526+0000","last_peered":"2023-06-23T18:51:15.142526+0000","last_clean":"2023-06-23T18:51:15.142526+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:51:15.142526+0000","last_undegraded":"2023-06-23T18:51:15.142526+0000","last_fullsized":"2023-06-23T18:51:15.142526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.142332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:49.196465+0000","scrub_duration":0.0037055650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.540700+0000","last_change":"2023-06-23T18:51:04.540803+0000","last_active":"2023-06-23T18:51:04.540700+0000","last_peered":"2023-06-23T18:51:04.540700+0000","last_clean":"2023-06-23T18:51:04.540700+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:51:04.540700+0000","last_undegraded":"2023-06-23T18:51:04.540700+0000","last_fullsized":"2023-06-23T18:51:04.540700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.540495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:25.678734+0000","scrub_duration":0.0032800960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.895535+0000","last_change":"2023-06-23T18:51:04.895594+0000","last_active":"2023-06-23T18:51:04.895535+0000","last_peered":"2023-06-23T18:51:04.895535+0000","last_clean":"2023-06-23T18:51:04.895535+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:51:04.895535+0000","last_undegraded":"2023-06-23T18:51:04.895535+0000","last_fullsized":"2023-06-23T18:51:04.895535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.895432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.033671+0000","scrub_duration":0.001770878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.367415+0000","last_change":"2023-06-23T18:51:18.367573+0000","last_active":"2023-06-23T18:51:18.367415+0000","last_peered":"2023-06-23T18:51:18.367415+0000","last_clean":"2023-06-23T18:51:18.367415+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:51:18.367415+0000","last_undegraded":"2023-06-23T18:51:18.367415+0000","last_fullsized":"2023-06-23T18:51:18.367415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.367192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:11.666258+0000","scrub_duration":0.0031402629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:03.673541+0000","last_change":"2023-06-23T18:51:03.673633+0000","last_active":"2023-06-23T18:51:03.673541+0000","last_peered":"2023-06-23T18:51:03.673541+0000","last_clean":"2023-06-23T18:51:03.673541+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:51:03.673541+0000","last_undegraded":"2023-06-23T18:51:03.673541+0000","last_fullsized":"2023-06-23T18:51:03.673541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_clean_scrub_stamp":"2023-06-23T18:51:03.673345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:05:45.269103+0000","scrub_duration":0.0037635910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554711+0000","last_change":"2023-06-23T18:49:36.764007+0000","last_active":"2023-06-23T18:49:41.554711+0000","last_peered":"2023-06-23T18:49:41.554711+0000","last_clean":"2023-06-23T18:49:41.554711+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:49:41.554711+0000","last_undegraded":"2023-06-23T18:49:41.554711+0000","last_fullsized":"2023-06-23T18:49:41.554711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.901799+0000","last_change":"2023-06-23T18:51:04.901895+0000","last_active":"2023-06-23T18:51:04.901799+0000","last_peered":"2023-06-23T18:51:04.901799+0000","last_clean":"2023-06-23T18:51:04.901799+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:51:04.901799+0000","last_undegraded":"2023-06-23T18:51:04.901799+0000","last_fullsized":"2023-06-23T18:51:04.901799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.901580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.039820+0000","scrub_duration":0.0032852200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.172564+0000","last_change":"2023-06-23T18:50:53.172651+0000","last_active":"2023-06-23T18:50:53.172564+0000","last_peered":"2023-06-23T18:50:53.172564+0000","last_clean":"2023-06-23T18:50:53.172564+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:50:53.172564+0000","last_undegraded":"2023-06-23T18:50:53.172564+0000","last_fullsized":"2023-06-23T18:50:53.172564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.172373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:06.374063+0000","scrub_duration":0.0034361800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.118750+0000","last_change":"2023-06-23T18:51:19.118846+0000","last_active":"2023-06-23T18:51:19.118750+0000","last_peered":"2023-06-23T18:51:19.118750+0000","last_clean":"2023-06-23T18:51:19.118750+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:51:19.118750+0000","last_undegraded":"2023-06-23T18:51:19.118750+0000","last_fullsized":"2023-06-23T18:51:19.118750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.118478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:07:21.530071+0000","scrub_duration":0.0037465380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:57.128158+0000","last_change":"2023-06-23T18:50:57.128267+0000","last_active":"2023-06-23T18:50:57.128158+0000","last_peered":"2023-06-23T18:50:57.128158+0000","last_clean":"2023-06-23T18:50:57.128158+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:50:57.128158+0000","last_undegraded":"2023-06-23T18:50:57.128158+0000","last_fullsized":"2023-06-23T18:50:57.128158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_clean_scrub_stamp":"2023-06-23T18:50:57.127936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:31.182068+0000","scrub_duration":0.0033896339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.010216+0000","last_change":"2023-06-23T18:50:53.010312+0000","last_active":"2023-06-23T18:50:53.010216+0000","last_peered":"2023-06-23T18:50:53.010216+0000","last_clean":"2023-06-23T18:50:53.010216+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:50:53.010216+0000","last_undegraded":"2023-06-23T18:50:53.010216+0000","last_fullsized":"2023-06-23T18:50:53.010216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.010001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.121565+0000","scrub_duration":0.0034279800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.553104+0000","last_change":"2023-06-23T18:49:36.802095+0000","last_active":"2023-06-23T18:49:41.553104+0000","last_peered":"2023-06-23T18:49:41.553104+0000","last_clean":"2023-06-23T18:49:41.553104+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:49:41.553104+0000","last_undegraded":"2023-06-23T18:49:41.553104+0000","last_fullsized":"2023-06-23T18:49:41.553104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.135828+0000","last_change":"2023-06-23T18:51:16.135927+0000","last_active":"2023-06-23T18:51:16.135828+0000","last_peered":"2023-06-23T18:51:16.135828+0000","last_clean":"2023-06-23T18:51:16.135828+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:51:16.135828+0000","last_undegraded":"2023-06-23T18:51:16.135828+0000","last_fullsized":"2023-06-23T18:51:16.135828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.135626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:33.268963+0000","scrub_duration":0.0035515730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.392603+0000","last_change":"2023-06-23T18:51:21.392764+0000","last_active":"2023-06-23T18:51:21.392603+0000","last_peered":"2023-06-23T18:51:21.392603+0000","last_clean":"2023-06-23T18:51:21.392603+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:51:21.392603+0000","last_undegraded":"2023-06-23T18:51:21.392603+0000","last_fullsized":"2023-06-23T18:51:21.392603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.392373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:51:06.440447+0000","scrub_duration":0.00346124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.932243+0000","last_change":"2023-06-23T18:51:06.932333+0000","last_active":"2023-06-23T18:51:06.932243+0000","last_peered":"2023-06-23T18:51:06.932243+0000","last_clean":"2023-06-23T18:51:06.932243+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:51:06.932243+0000","last_undegraded":"2023-06-23T18:51:06.932243+0000","last_fullsized":"2023-06-23T18:51:06.932243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.932039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.485465+0000","scrub_duration":0.0035631550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.037999+0000","last_change":"2023-06-23T18:50:55.038156+0000","last_active":"2023-06-23T18:50:55.037999+0000","last_peered":"2023-06-23T18:50:55.037999+0000","last_clean":"2023-06-23T18:50:55.037999+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:50:55.037999+0000","last_undegraded":"2023-06-23T18:50:55.037999+0000","last_fullsized":"2023-06-23T18:50:55.037999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.037786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.318885+0000","scrub_duration":0.0033358239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.840672+0000","last_change":"2023-06-23T18:50:47.840761+0000","last_active":"2023-06-23T18:50:47.840672+0000","last_peered":"2023-06-23T18:50:47.840672+0000","last_clean":"2023-06-23T18:50:47.840672+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:50:47.840672+0000","last_undegraded":"2023-06-23T18:50:47.840672+0000","last_fullsized":"2023-06-23T18:50:47.840672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.840462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:48.032261+0000","scrub_duration":0.0036463200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.964011+0000","last_change":"2023-06-23T18:50:54.964106+0000","last_active":"2023-06-23T18:50:54.964011+0000","last_peered":"2023-06-23T18:50:54.964011+0000","last_clean":"2023-06-23T18:50:54.964011+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:50:54.964011+0000","last_undegraded":"2023-06-23T18:50:54.964011+0000","last_fullsized":"2023-06-23T18:50:54.964011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.244910+0000","scrub_duration":0.0037456719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:08.183756+0000","last_change":"2023-06-23T18:51:08.183847+0000","last_active":"2023-06-23T18:51:08.183756+0000","last_peered":"2023-06-23T18:51:08.183756+0000","last_clean":"2023-06-23T18:51:08.183756+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:51:08.183756+0000","last_undegraded":"2023-06-23T18:51:08.183756+0000","last_fullsized":"2023-06-23T18:51:08.183756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_clean_scrub_stamp":"2023-06-23T18:51:08.183558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:37.383643+0000","scrub_duration":0.003312274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.545628+0000","last_change":"2023-06-23T18:49:36.808197+0000","last_active":"2023-06-23T18:49:41.545628+0000","last_peered":"2023-06-23T18:49:41.545628+0000","last_clean":"2023-06-23T18:49:41.545628+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:49:41.545628+0000","last_undegraded":"2023-06-23T18:49:41.545628+0000","last_fullsized":"2023-06-23T18:49:41.545628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.569431+0000","last_change":"2023-06-23T18:50:49.569592+0000","last_active":"2023-06-23T18:50:49.569431+0000","last_peered":"2023-06-23T18:50:49.569431+0000","last_clean":"2023-06-23T18:50:49.569431+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:50:49.569431+0000","last_undegraded":"2023-06-23T18:50:49.569431+0000","last_fullsized":"2023-06-23T18:50:49.569431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.569200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:29:53.991735+0000","scrub_duration":0.0038698320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.353794+0000","last_change":"2023-06-23T18:50:53.353850+0000","last_active":"2023-06-23T18:50:53.353794+0000","last_peered":"2023-06-23T18:50:53.353794+0000","last_clean":"2023-06-23T18:50:53.353794+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:50:53.353794+0000","last_undegraded":"2023-06-23T18:50:53.353794+0000","last_fullsized":"2023-06-23T18:50:53.353794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.353661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:14.491900+0000","scrub_duration":0.0026633910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.554238+0000","last_change":"2023-06-23T18:49:36.772180+0000","last_active":"2023-06-23T18:49:41.554238+0000","last_peered":"2023-06-23T18:49:41.554238+0000","last_clean":"2023-06-23T18:49:41.554238+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:49:41.554238+0000","last_undegraded":"2023-06-23T18:49:41.554238+0000","last_fullsized":"2023-06-23T18:49:41.554238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.249294+0000","last_change":"2023-06-23T18:50:44.249389+0000","last_active":"2023-06-23T18:50:44.249294+0000","last_peered":"2023-06-23T18:50:44.249294+0000","last_clean":"2023-06-23T18:50:44.249294+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:50:44.249294+0000","last_undegraded":"2023-06-23T18:50:44.249294+0000","last_fullsized":"2023-06-23T18:50:44.249294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.249097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:55.436409+0000","scrub_duration":0.0034108699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:41.549923+0000","last_change":"2023-06-23T18:49:36.767950+0000","last_active":"2023-06-23T18:49:41.549923+0000","last_peered":"2023-06-23T18:49:41.549923+0000","last_clean":"2023-06-23T18:49:41.549923+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:49:41.549923+0000","last_undegraded":"2023-06-23T18:49:41.549923+0000","last_fullsized":"2023-06-23T18:49:41.549923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:36.351181+0000","last_clean_scrub_stamp":"2023-06-23T18:49:36.351181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:42.904789+0000","last_change":"2023-06-23T18:50:42.904856+0000","last_active":"2023-06-23T18:50:42.904789+0000","last_peered":"2023-06-23T18:50:42.904789+0000","last_clean":"2023-06-23T18:50:42.904789+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:50:42.904789+0000","last_undegraded":"2023-06-23T18:50:42.904789+0000","last_fullsized":"2023-06-23T18:50:42.904789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_clean_scrub_stamp":"2023-06-23T18:50:42.904670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:59.196272+0000","scrub_duration":0.001431545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.850052+0000","last_change":"2023-06-23T18:50:44.850145+0000","last_active":"2023-06-23T18:50:44.850052+0000","last_peered":"2023-06-23T18:50:44.850052+0000","last_clean":"2023-06-23T18:50:44.850052+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:50:44.850052+0000","last_undegraded":"2023-06-23T18:50:44.850052+0000","last_fullsized":"2023-06-23T18:50:44.850052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.849822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:57:45.611206+0000","scrub_duration":0.0040367679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.818626+0000","last_change":"2023-06-23T18:51:16.818729+0000","last_active":"2023-06-23T18:51:16.818626+0000","last_peered":"2023-06-23T18:51:16.818626+0000","last_clean":"2023-06-23T18:51:16.818626+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:51:16.818626+0000","last_undegraded":"2023-06-23T18:51:16.818626+0000","last_fullsized":"2023-06-23T18:51:16.818626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.818400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:54.435055+0000","scrub_duration":0.0031917149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.841792+0000","last_change":"2023-06-23T18:51:15.841885+0000","last_active":"2023-06-23T18:51:15.841792+0000","last_peered":"2023-06-23T18:51:15.841792+0000","last_clean":"2023-06-23T18:51:15.841792+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:51:15.841792+0000","last_undegraded":"2023-06-23T18:51:15.841792+0000","last_fullsized":"2023-06-23T18:51:15.841792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.308974+0000","scrub_duration":0.0037383379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.889772+0000","last_change":"2023-06-23T18:51:17.889932+0000","last_active":"2023-06-23T18:51:17.889772+0000","last_peered":"2023-06-23T18:51:17.889772+0000","last_clean":"2023-06-23T18:51:17.889772+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:51:17.889772+0000","last_undegraded":"2023-06-23T18:51:17.889772+0000","last_fullsized":"2023-06-23T18:51:17.889772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.889533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.585477+0000","scrub_duration":0.0036828059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.864079+0000","last_change":"2023-06-23T18:51:14.864247+0000","last_active":"2023-06-23T18:51:14.864079+0000","last_peered":"2023-06-23T18:51:14.864079+0000","last_clean":"2023-06-23T18:51:14.864079+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:51:14.864079+0000","last_undegraded":"2023-06-23T18:51:14.864079+0000","last_fullsized":"2023-06-23T18:51:14.864079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.863822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:39:19.677369+0000","scrub_duration":0.0039650900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.522697+0000","last_change":"2023-06-23T18:51:10.522861+0000","last_active":"2023-06-23T18:51:10.522697+0000","last_peered":"2023-06-23T18:51:10.522697+0000","last_clean":"2023-06-23T18:51:10.522697+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:51:10.522697+0000","last_undegraded":"2023-06-23T18:51:10.522697+0000","last_fullsized":"2023-06-23T18:51:10.522697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.522471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:29:37.879654+0000","scrub_duration":0.0033039380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6334,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.034},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.996}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.208},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.81799999999999995}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.91900000000000004}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.871},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.1619999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0309999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.25},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.115}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.292}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.069},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.98199999999999998}]},{"osd":2,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.244},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.274}]},{"osd":6,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.204},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.111}]},{"osd":7,"last update":"Fri Jun 23 18:50:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.153},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.3180000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.5},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88700000000000001}]},{"osd":5,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:50:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.25}]}]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.042},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.94999999999999996}]},{"osd":5,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.96999999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.749}]},{"osd":2,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.008},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:50:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.80200000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.038}]},{"osd":1,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68999999999999995}]},{"osd":2,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.081},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.155},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.879}]},{"osd":5,"last update":"Fri Jun 23 18:50:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.1839999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:50:29 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.212},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.234}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.081},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.23}]},{"osd":6,"last update":"Fri Jun 23 18:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.27}]},{"osd":7,"last update":"Fri Jun 23 18:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:51:25.353 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.354 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.354 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.355 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.355 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.355 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.356 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.356 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.357 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.357 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.357 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.358 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.358 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.358 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-06-23T18:49:31.295542+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=31, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.359 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.359 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.360 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.360 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.361 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.361 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.361 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.362 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.362 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.363 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.363 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.363 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.364 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.364 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.365 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.365 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.365 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.366 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.366 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.366 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.367 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.367 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.367 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.368 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.368 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.368 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-06-23T18:49:35.338027+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=35, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.368 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.369 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.369 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.370 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.370 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.370 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-06-23T18:49:36.351181+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=36, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:25.371 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-23T18:51:45.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:51:45.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.494+0000 7f41a1a4a640 1 Processor -- start 2023-06-23T18:51:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f41a1a4a640 1 -- start start 2023-06-23T18:51:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f41a1a4a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f419c14b930 0x7f419c06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f41a1a4a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c0ba9d0 con 0x7f419c0bd1e0 2023-06-23T18:51:45.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f41a1a4a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c071080 con 0x7f419c06c9b0 2023-06-23T18:51:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f41a1a4a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0bc300 con 0x7f419c14b930 2023-06-23T18:51:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f419c14b930 0x7f419c06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419a7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f419c0bd1e0 0x7f419c070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45108/0 (socket says 172.21.15.38:45108) 2023-06-23T18:51:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419a7fc640 1 -- 172.21.15.38:0/170561745 learned_addr learned my addr 172.21.15.38:0/170561745 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:51:45.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419affd640 1 -- 172.21.15.38:0/170561745 >> v1:172.21.15.81:6789/0 conn(0x7f419c06c9b0 legacy=0x7f419c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:51:45.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419affd640 1 -- 172.21.15.38:0/170561745 >> v1:172.21.15.38:6789/0 conn(0x7f419c0bd1e0 legacy=0x7f419c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f4199ffb640 1 -- 172.21.15.38:0/170561745 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172729652 0 0) 0x7f419c0ba9d0 con 0x7f419c0bd1e0 2023-06-23T18:51:45.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.498+0000 7f419affd640 1 -- 172.21.15.38:0/170561745 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c150160 con 0x7f419c14b930 2023-06-23T18:51:45.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f419affd640 1 --2- 172.21.15.38:0/170561745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c06c470 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f41840097c0 tx=0x7f418401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe229c392c2e535 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:45.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f4199ffb640 1 -- 172.21.15.38:0/170561745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840ac630 con 0x7f419c14b930 2023-06-23T18:51:45.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f4199ffb640 1 -- 172.21.15.38:0/170561745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840ac790 con 0x7f419c14b930 2023-06-23T18:51:45.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f4199ffb640 1 -- 172.21.15.38:0/170561745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840acb20 con 0x7f419c14b930 2023-06-23T18:51:45.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- 172.21.15.38:0/170561745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 msgr2=0x7f419c06c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/170561745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c06c470 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f41840097c0 tx=0x7f418401c3b0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- 172.21.15.38:0/170561745 shutdown_connections 2023-06-23T18:51:45.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/170561745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c06c470 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- 172.21.15.38:0/170561745 >> 172.21.15.38:0/170561745 conn(0x7f419c0c0c90 msgr2=0x7f419c0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:45.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- 172.21.15.38:0/170561745 shutdown_connections 2023-06-23T18:51:45.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- 172.21.15.38:0/170561745 wait complete. 2023-06-23T18:51:45.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 Processor -- start 2023-06-23T18:51:45.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.502+0000 7f41a1a4a640 1 -- start start 2023-06-23T18:51:45.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 0x7f419c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:45.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f419c0bd1e0 0x7f419c13e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:45.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:45.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0a5570 con 0x7f419c14b930 2023-06-23T18:51:45.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0b5bb0 con 0x7f419c06c9b0 2023-06-23T18:51:45.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c14ac90 con 0x7f419c0bd1e0 2023-06-23T18:51:45.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:45.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44542/0 (socket says 172.21.15.38:44542) 2023-06-23T18:51:45.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 -- 172.21.15.38:0/3664460928 learned_addr learned my addr 172.21.15.38:0/3664460928 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:51:45.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419affd640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 0x7f419c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:45.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419a7fc640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f419c0bd1e0 0x7f419c13e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:45.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 -- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f419c0bd1e0 msgr2=0x7f419c13e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f419c0bd1e0 0x7f419c13e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 -- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 msgr2=0x7f419c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 0x7f419c14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 -- 172.21.15.38:0/3664460928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184009420 con 0x7f419c14b930 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419affd640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 0x7f419c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:51:45.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419b7fe640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f419400c780 tx=0x7f419400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:45.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194004b70 con 0x7f419c14b930 2023-06-23T18:51:45.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400ce90 con 0x7f419c14b930 2023-06-23T18:51:45.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400a850 con 0x7f419c14b930 2023-06-23T18:51:45.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c0b6320 con 0x7f419c14b930 2023-06-23T18:51:45.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c0b5e00 con 0x7f419c14b930 2023-06-23T18:51:45.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c0b6020 con 0x7f419c14b930 2023-06-23T18:51:45.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f419400a9b0 con 0x7f419c14b930 2023-06-23T18:51:45.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:51:45.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4194084460 con 0x7f419c14b930 2023-06-23T18:51:45.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.506+0000 7f419affd640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:51:45.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.510+0000 7f419affd640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 0x7f417c068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f41840ae000 tx=0x7f41840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:51:45.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.510+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4194055110 con 0x7f419c14b930 2023-06-23T18:51:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.662+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f419c15a580 con 0x7f417c066280 2023-06-23T18:51:45.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.690+0000 7f4193fff640 1 -- 172.21.15.38:0/3664460928 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392583 (secure 0 0 0) 0x7f41840040c0 con 0x7f417c066280 2023-06-23T18:51:45.706 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:51:45.708 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:51:45.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 msgr2=0x7f417c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 0x7f417c068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f41840ae000 tx=0x7f41840a7000 comp rx=0 tx=0).stop 2023-06-23T18:51:45.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 msgr2=0x7f419c13e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:51:45.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f419400c780 tx=0x7f419400cc40 comp rx=0 tx=0).stop 2023-06-23T18:51:45.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 shutdown_connections 2023-06-23T18:51:45.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f419c14b930 0x7f419c13e940 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f419c0bd1e0 0x7f419c13e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 --2- 172.21.15.38:0/3664460928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419c06c9b0 0x7f419c14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:51:45.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 >> 172.21.15.38:0/3664460928 conn(0x7f419c0c0c90 msgr2=0x7f419c0b9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:51:45.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 shutdown_connections 2023-06-23T18:51:45.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:51:45.698+0000 7f41a1a4a640 1 -- 172.21.15.38:0/3664460928 wait complete. 2023-06-23T18:51:45.724 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-06-23T18:51:45.323512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596702,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740216,"statfs":{"total":773094113280,"available":772853981184,"internally_reserved":0,"allocated":2564096,"data_stored":2162460,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005043"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.725690+0000","last_change":"2023-06-23T18:51:35.725876+0000","last_active":"2023-06-23T18:51:35.725690+0000","last_peered":"2023-06-23T18:51:35.725690+0000","last_clean":"2023-06-23T18:51:35.725690+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:51:35.725690+0000","last_undegraded":"2023-06-23T18:51:35.725690+0000","last_fullsized":"2023-06-23T18:51:35.725690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.725477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.725477+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.725477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:56.150643+0000","scrub_duration":0.0043453010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.630354+0000","last_change":"2023-06-23T18:51:01.630354+0000","last_active":"2023-06-23T18:51:01.630354+0000","last_peered":"2023-06-23T18:51:01.630354+0000","last_clean":"2023-06-23T18:51:01.630354+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:51:01.630354+0000","last_undegraded":"2023-06-23T18:51:01.630354+0000","last_fullsized":"2023-06-23T18:51:01.630354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.629955+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:47:56.036543+0000","scrub_duration":0.0081086479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.908554+0000","last_change":"2023-06-23T18:51:30.908647+0000","last_active":"2023-06-23T18:51:30.908554+0000","last_peered":"2023-06-23T18:51:30.908554+0000","last_clean":"2023-06-23T18:51:30.908554+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:51:30.908554+0000","last_undegraded":"2023-06-23T18:51:30.908554+0000","last_fullsized":"2023-06-23T18:51:30.908554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.908354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.908354+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.908354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:05.927642+0000","scrub_duration":0.003561107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.017642+0000","last_change":"2023-06-23T18:51:35.017788+0000","last_active":"2023-06-23T18:51:35.017642+0000","last_peered":"2023-06-23T18:51:35.017642+0000","last_clean":"2023-06-23T18:51:35.017642+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:51:35.017642+0000","last_undegraded":"2023-06-23T18:51:35.017642+0000","last_fullsized":"2023-06-23T18:51:35.017642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.017419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.017419+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.017419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:16:35.826826+0000","scrub_duration":0.0040819259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.589921+0000","last_change":"2023-06-23T18:50:58.589921+0000","last_active":"2023-06-23T18:50:58.589921+0000","last_peered":"2023-06-23T18:50:58.589921+0000","last_clean":"2023-06-23T18:50:58.589921+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:50:58.589921+0000","last_undegraded":"2023-06-23T18:50:58.589921+0000","last_fullsized":"2023-06-23T18:50:58.589921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.589589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:39.052945+0000","scrub_duration":0.0036881570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.023838+0000","last_change":"2023-06-23T18:50:50.023931+0000","last_active":"2023-06-23T18:50:50.023838+0000","last_peered":"2023-06-23T18:50:50.023838+0000","last_clean":"2023-06-23T18:50:50.023838+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:50:50.023838+0000","last_undegraded":"2023-06-23T18:50:50.023838+0000","last_fullsized":"2023-06-23T18:50:50.023838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.023624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.888239+0000","scrub_duration":0.0031280280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:25.966208+0000","last_change":"2023-06-23T18:51:25.966356+0000","last_active":"2023-06-23T18:51:25.966208+0000","last_peered":"2023-06-23T18:51:25.966208+0000","last_clean":"2023-06-23T18:51:25.966208+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:51:25.966208+0000","last_undegraded":"2023-06-23T18:51:25.966208+0000","last_fullsized":"2023-06-23T18:51:25.966208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:25.965985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:25.965985+0000","last_clean_scrub_stamp":"2023-06-23T18:51:25.965985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:24.582093+0000","scrub_duration":0.0041428189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.794729+0000","last_change":"2023-06-23T18:50:52.794857+0000","last_active":"2023-06-23T18:50:52.794729+0000","last_peered":"2023-06-23T18:50:52.794729+0000","last_clean":"2023-06-23T18:50:52.794729+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:50:52.794729+0000","last_undegraded":"2023-06-23T18:50:52.794729+0000","last_fullsized":"2023-06-23T18:50:52.794729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.794494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:15:53.603901+0000","scrub_duration":0.006501817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:00.074838+0000","last_change":"2023-06-23T18:51:00.074931+0000","last_active":"2023-06-23T18:51:00.074838+0000","last_peered":"2023-06-23T18:51:00.074838+0000","last_clean":"2023-06-23T18:51:00.074838+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:51:00.074838+0000","last_undegraded":"2023-06-23T18:51:00.074838+0000","last_fullsized":"2023-06-23T18:51:00.074838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:00.074635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:21.212875+0000","scrub_duration":0.003561402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.000987+0000","last_change":"2023-06-23T18:51:27.001120+0000","last_active":"2023-06-23T18:51:27.000987+0000","last_peered":"2023-06-23T18:51:27.000987+0000","last_clean":"2023-06-23T18:51:27.000987+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:51:27.000987+0000","last_undegraded":"2023-06-23T18:51:27.000987+0000","last_fullsized":"2023-06-23T18:51:27.000987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.000765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.000765+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.000765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:58:27.762149+0000","scrub_duration":0.0036488359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.211877+0000","last_change":"2023-06-23T18:51:06.211982+0000","last_active":"2023-06-23T18:51:06.211877+0000","last_peered":"2023-06-23T18:51:06.211877+0000","last_clean":"2023-06-23T18:51:06.211877+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:51:06.211877+0000","last_undegraded":"2023-06-23T18:51:06.211877+0000","last_fullsized":"2023-06-23T18:51:06.211877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.211678+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:01.907622+0000","scrub_duration":0.0065308069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.905128+0000","last_change":"2023-06-23T18:51:17.905227+0000","last_active":"2023-06-23T18:51:17.905128+0000","last_peered":"2023-06-23T18:51:17.905128+0000","last_clean":"2023-06-23T18:51:17.905128+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:51:17.905128+0000","last_undegraded":"2023-06-23T18:51:17.905128+0000","last_fullsized":"2023-06-23T18:51:17.905128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.904924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:31.106614+0000","scrub_duration":0.0037596510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.790864+0000","last_change":"2023-06-23T18:51:26.791102+0000","last_active":"2023-06-23T18:51:26.790864+0000","last_peered":"2023-06-23T18:51:26.790864+0000","last_clean":"2023-06-23T18:51:26.790864+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:51:26.790864+0000","last_undegraded":"2023-06-23T18:51:26.790864+0000","last_fullsized":"2023-06-23T18:51:26.790864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.790646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.790646+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.790646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:00:05.191923+0000","scrub_duration":0.0039504259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:11.933024+0000","last_change":"2023-06-23T18:51:11.933155+0000","last_active":"2023-06-23T18:51:11.933024+0000","last_peered":"2023-06-23T18:51:11.933024+0000","last_clean":"2023-06-23T18:51:11.933024+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:51:11.933024+0000","last_undegraded":"2023-06-23T18:51:11.933024+0000","last_fullsized":"2023-06-23T18:51:11.933024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_clean_scrub_stamp":"2023-06-23T18:51:11.932789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:49:12.124588+0000","scrub_duration":0.0036546809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.081975+0000","last_change":"2023-06-23T18:50:58.082067+0000","last_active":"2023-06-23T18:50:58.081975+0000","last_peered":"2023-06-23T18:50:58.081975+0000","last_clean":"2023-06-23T18:50:58.081975+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:50:58.081975+0000","last_undegraded":"2023-06-23T18:50:58.081975+0000","last_fullsized":"2023-06-23T18:50:58.081975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.081770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:15.215107+0000","scrub_duration":0.0035039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.956524+0000","last_change":"2023-06-23T18:51:26.956718+0000","last_active":"2023-06-23T18:51:26.956524+0000","last_peered":"2023-06-23T18:51:26.956524+0000","last_clean":"2023-06-23T18:51:26.956524+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:51:26.956524+0000","last_undegraded":"2023-06-23T18:51:26.956524+0000","last_fullsized":"2023-06-23T18:51:26.956524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.956305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.956305+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.956305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:21.268357+0000","scrub_duration":0.003805891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.266030+0000","last_change":"2023-06-23T18:51:01.266147+0000","last_active":"2023-06-23T18:51:01.266030+0000","last_peered":"2023-06-23T18:51:01.266030+0000","last_clean":"2023-06-23T18:51:01.266030+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:51:01.266030+0000","last_undegraded":"2023-06-23T18:51:01.266030+0000","last_fullsized":"2023-06-23T18:51:01.266030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.265826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:12.453139+0000","scrub_duration":0.0036297460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.027351+0000","last_change":"2023-06-23T18:51:16.027441+0000","last_active":"2023-06-23T18:51:16.027351+0000","last_peered":"2023-06-23T18:51:16.027351+0000","last_clean":"2023-06-23T18:51:16.027351+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:51:16.027351+0000","last_undegraded":"2023-06-23T18:51:16.027351+0000","last_fullsized":"2023-06-23T18:51:16.027351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.027155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.494549+0000","scrub_duration":0.0033927509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:28.906716+0000","last_change":"2023-06-23T18:51:28.906846+0000","last_active":"2023-06-23T18:51:28.906716+0000","last_peered":"2023-06-23T18:51:28.906716+0000","last_clean":"2023-06-23T18:51:28.906716+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:51:28.906716+0000","last_undegraded":"2023-06-23T18:51:28.906716+0000","last_fullsized":"2023-06-23T18:51:28.906716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:28.906482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:28.906482+0000","last_clean_scrub_stamp":"2023-06-23T18:51:28.906482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:10.527257+0000","scrub_duration":0.0040950709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.078859+0000","last_change":"2023-06-23T18:51:02.078956+0000","last_active":"2023-06-23T18:51:02.078859+0000","last_peered":"2023-06-23T18:51:02.078859+0000","last_clean":"2023-06-23T18:51:02.078859+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:51:02.078859+0000","last_undegraded":"2023-06-23T18:51:02.078859+0000","last_fullsized":"2023-06-23T18:51:02.078859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.078635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:53:56.390687+0000","scrub_duration":0.003585436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.211554+0000","last_change":"2023-06-23T18:50:50.211554+0000","last_active":"2023-06-23T18:50:50.211554+0000","last_peered":"2023-06-23T18:50:50.211554+0000","last_clean":"2023-06-23T18:50:50.211554+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:50:50.211554+0000","last_undegraded":"2023-06-23T18:50:50.211554+0000","last_fullsized":"2023-06-23T18:50:50.211554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.211152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:38:55.024699+0000","scrub_duration":0.0034905040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.689058+0000","last_change":"2023-06-23T18:51:27.689058+0000","last_active":"2023-06-23T18:51:27.689058+0000","last_peered":"2023-06-23T18:51:27.689058+0000","last_clean":"2023-06-23T18:51:27.689058+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:51:27.689058+0000","last_undegraded":"2023-06-23T18:51:27.689058+0000","last_fullsized":"2023-06-23T18:51:27.689058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.688628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.688628+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.688628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:44.821965+0000","scrub_duration":0.0040759409999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.521370+0000","last_change":"2023-06-23T18:50:53.521469+0000","last_active":"2023-06-23T18:50:53.521370+0000","last_peered":"2023-06-23T18:50:53.521370+0000","last_clean":"2023-06-23T18:50:53.521370+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:50:53.521370+0000","last_undegraded":"2023-06-23T18:50:53.521370+0000","last_fullsized":"2023-06-23T18:50:53.521370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.521154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:12:32.302169+0000","scrub_duration":0.0038767810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.834781+0000","last_change":"2023-06-23T18:50:55.834781+0000","last_active":"2023-06-23T18:50:55.834781+0000","last_peered":"2023-06-23T18:50:55.834781+0000","last_clean":"2023-06-23T18:50:55.834781+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:50:55.834781+0000","last_undegraded":"2023-06-23T18:50:55.834781+0000","last_fullsized":"2023-06-23T18:50:55.834781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.834438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:19:22.644409+0000","scrub_duration":0.0035002900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:13.025108+0000","last_change":"2023-06-23T18:51:13.025201+0000","last_active":"2023-06-23T18:51:13.025108+0000","last_peered":"2023-06-23T18:51:13.025108+0000","last_clean":"2023-06-23T18:51:13.025108+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:51:13.025108+0000","last_undegraded":"2023-06-23T18:51:13.025108+0000","last_fullsized":"2023-06-23T18:51:13.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_clean_scrub_stamp":"2023-06-23T18:51:13.024867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.212180+0000","scrub_duration":0.0034090629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.566433+0000","last_change":"2023-06-23T18:50:54.566595+0000","last_active":"2023-06-23T18:50:54.566433+0000","last_peered":"2023-06-23T18:50:54.566433+0000","last_clean":"2023-06-23T18:50:54.566433+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:50:54.566433+0000","last_undegraded":"2023-06-23T18:50:54.566433+0000","last_fullsized":"2023-06-23T18:50:54.566433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.566209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:15.460398+0000","scrub_duration":0.0040031069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.301913+0000","last_change":"2023-06-23T18:49:40.840606+0000","last_active":"2023-06-23T18:49:44.301913+0000","last_peered":"2023-06-23T18:49:44.301913+0000","last_clean":"2023-06-23T18:49:44.301913+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:49:44.301913+0000","last_undegraded":"2023-06-23T18:49:44.301913+0000","last_fullsized":"2023-06-23T18:49:44.301913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.195109+0000","last_change":"2023-06-23T18:50:46.195216+0000","last_active":"2023-06-23T18:50:46.195109+0000","last_peered":"2023-06-23T18:50:46.195109+0000","last_clean":"2023-06-23T18:50:46.195109+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:50:46.195109+0000","last_undegraded":"2023-06-23T18:50:46.195109+0000","last_fullsized":"2023-06-23T18:50:46.195109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.194901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:05:11.372699+0000","scrub_duration":0.0039927290000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.242899+0000","last_change":"2023-06-23T18:50:44.242992+0000","last_active":"2023-06-23T18:50:44.242899+0000","last_peered":"2023-06-23T18:50:44.242899+0000","last_clean":"2023-06-23T18:50:44.242899+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:50:44.242899+0000","last_undegraded":"2023-06-23T18:50:44.242899+0000","last_fullsized":"2023-06-23T18:50:44.242899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.242702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:35.107318+0000","scrub_duration":0.0033288580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.894372+0000","last_change":"2023-06-23T18:51:22.894505+0000","last_active":"2023-06-23T18:51:22.894372+0000","last_peered":"2023-06-23T18:51:22.894372+0000","last_clean":"2023-06-23T18:51:22.894372+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:51:22.894372+0000","last_undegraded":"2023-06-23T18:51:22.894372+0000","last_fullsized":"2023-06-23T18:51:22.894372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.894176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.894176+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.894176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:40.027513+0000","scrub_duration":0.0038051339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.922718+0000","last_change":"2023-06-23T18:50:52.922831+0000","last_active":"2023-06-23T18:50:52.922718+0000","last_peered":"2023-06-23T18:50:52.922718+0000","last_clean":"2023-06-23T18:50:52.922718+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:50:52.922718+0000","last_undegraded":"2023-06-23T18:50:52.922718+0000","last_fullsized":"2023-06-23T18:50:52.922718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.922501+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.034066+0000","scrub_duration":0.0078325200000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.236438+0000","last_change":"2023-06-23T18:50:47.236534+0000","last_active":"2023-06-23T18:50:47.236438+0000","last_peered":"2023-06-23T18:50:47.236438+0000","last_clean":"2023-06-23T18:50:47.236438+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:50:47.236438+0000","last_undegraded":"2023-06-23T18:50:47.236438+0000","last_fullsized":"2023-06-23T18:50:47.236438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.236189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:23.521561+0000","scrub_duration":0.003811432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.814327+0000","last_change":"2023-06-23T18:51:27.814461+0000","last_active":"2023-06-23T18:51:27.814327+0000","last_peered":"2023-06-23T18:51:27.814327+0000","last_clean":"2023-06-23T18:51:27.814327+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:51:27.814327+0000","last_undegraded":"2023-06-23T18:51:27.814327+0000","last_fullsized":"2023-06-23T18:51:27.814327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.814084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.814084+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.814084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:32:19.699034+0000","scrub_duration":0.003688981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.706754+0000","last_change":"2023-06-23T18:51:04.706830+0000","last_active":"2023-06-23T18:51:04.706754+0000","last_peered":"2023-06-23T18:51:04.706754+0000","last_clean":"2023-06-23T18:51:04.706754+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:51:04.706754+0000","last_undegraded":"2023-06-23T18:51:04.706754+0000","last_fullsized":"2023-06-23T18:51:04.706754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.706637+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:31:56.591587+0000","scrub_duration":0.0056771579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.030649+0000","last_change":"2023-06-23T18:51:02.030740+0000","last_active":"2023-06-23T18:51:02.030649+0000","last_peered":"2023-06-23T18:51:02.030649+0000","last_clean":"2023-06-23T18:51:02.030649+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:51:02.030649+0000","last_undegraded":"2023-06-23T18:51:02.030649+0000","last_fullsized":"2023-06-23T18:51:02.030649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.030409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:05.583835+0000","scrub_duration":0.00380671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.718328+0000","last_change":"2023-06-23T18:51:30.718453+0000","last_active":"2023-06-23T18:51:30.718328+0000","last_peered":"2023-06-23T18:51:30.718328+0000","last_clean":"2023-06-23T18:51:30.718328+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:51:30.718328+0000","last_undegraded":"2023-06-23T18:51:30.718328+0000","last_fullsized":"2023-06-23T18:51:30.718328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.718116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.718116+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.718116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:29.334223+0000","scrub_duration":0.0043417129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.940123+0000","last_change":"2023-06-23T18:51:07.940123+0000","last_active":"2023-06-23T18:51:07.940123+0000","last_peered":"2023-06-23T18:51:07.940123+0000","last_clean":"2023-06-23T18:51:07.940123+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:51:07.940123+0000","last_undegraded":"2023-06-23T18:51:07.940123+0000","last_fullsized":"2023-06-23T18:51:07.940123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.939690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:19.127003+0000","scrub_duration":0.0034629029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.756658+0000","last_change":"2023-06-23T18:51:22.756658+0000","last_active":"2023-06-23T18:51:22.756658+0000","last_peered":"2023-06-23T18:51:22.756658+0000","last_clean":"2023-06-23T18:51:22.756658+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:51:22.756658+0000","last_undegraded":"2023-06-23T18:51:22.756658+0000","last_fullsized":"2023-06-23T18:51:22.756658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.756310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.756310+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.756310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:53:58.669588+0000","scrub_duration":0.0033271619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:05.937651+0000","last_change":"2023-06-23T18:51:05.937842+0000","last_active":"2023-06-23T18:51:05.937651+0000","last_peered":"2023-06-23T18:51:05.937651+0000","last_clean":"2023-06-23T18:51:05.937651+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:51:05.937651+0000","last_undegraded":"2023-06-23T18:51:05.937651+0000","last_fullsized":"2023-06-23T18:51:05.937651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_clean_scrub_stamp":"2023-06-23T18:51:05.937431+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:08:40.956719+0000","scrub_duration":0.006516399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.846661+0000","last_change":"2023-06-23T18:51:22.846661+0000","last_active":"2023-06-23T18:51:22.846661+0000","last_peered":"2023-06-23T18:51:22.846661+0000","last_clean":"2023-06-23T18:51:22.846661+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:51:22.846661+0000","last_undegraded":"2023-06-23T18:51:22.846661+0000","last_fullsized":"2023-06-23T18:51:22.846661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.846264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.846264+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.846264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:26.876135+0000","scrub_duration":0.0041846449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.859824+0000","last_change":"2023-06-23T18:51:15.859824+0000","last_active":"2023-06-23T18:51:15.859824+0000","last_peered":"2023-06-23T18:51:15.859824+0000","last_clean":"2023-06-23T18:51:15.859824+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:51:15.859824+0000","last_undegraded":"2023-06-23T18:51:15.859824+0000","last_fullsized":"2023-06-23T18:51:15.859824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.859533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:16:16.668940+0000","scrub_duration":0.0038012860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.108971+0000","last_change":"2023-06-23T18:51:01.108971+0000","last_active":"2023-06-23T18:51:01.108971+0000","last_peered":"2023-06-23T18:51:01.108971+0000","last_clean":"2023-06-23T18:51:01.108971+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:51:01.108971+0000","last_undegraded":"2023-06-23T18:51:01.108971+0000","last_fullsized":"2023-06-23T18:51:01.108971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.108678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:49:59.724785+0000","scrub_duration":0.0037045720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.973326+0000","last_change":"2023-06-23T18:51:07.973434+0000","last_active":"2023-06-23T18:51:07.973326+0000","last_peered":"2023-06-23T18:51:07.973326+0000","last_clean":"2023-06-23T18:51:07.973326+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:51:07.973326+0000","last_undegraded":"2023-06-23T18:51:07.973326+0000","last_fullsized":"2023-06-23T18:51:07.973326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.973139+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:58:08.734523+0000","scrub_duration":0.0064564239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:38.966551+0000","last_change":"2023-06-23T18:51:38.966728+0000","last_active":"2023-06-23T18:51:38.966551+0000","last_peered":"2023-06-23T18:51:38.966551+0000","last_clean":"2023-06-23T18:51:38.966551+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:51:38.966551+0000","last_undegraded":"2023-06-23T18:51:38.966551+0000","last_fullsized":"2023-06-23T18:51:38.966551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:38.966333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:38.966333+0000","last_clean_scrub_stamp":"2023-06-23T18:51:38.966333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:00:29.598121+0000","scrub_duration":0.00388318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.638471+0000","last_change":"2023-06-23T18:51:21.638471+0000","last_active":"2023-06-23T18:51:21.638471+0000","last_peered":"2023-06-23T18:51:21.638471+0000","last_clean":"2023-06-23T18:51:21.638471+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:51:21.638471+0000","last_undegraded":"2023-06-23T18:51:21.638471+0000","last_fullsized":"2023-06-23T18:51:21.638471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.638159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.638159+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.638159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:34.839849+0000","scrub_duration":0.0038764789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.727701+0000","last_change":"2023-06-23T18:51:16.727701+0000","last_active":"2023-06-23T18:51:16.727701+0000","last_peered":"2023-06-23T18:51:16.727701+0000","last_clean":"2023-06-23T18:51:16.727701+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:51:16.727701+0000","last_undegraded":"2023-06-23T18:51:16.727701+0000","last_fullsized":"2023-06-23T18:51:16.727701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.727396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:21.123261+0000","scrub_duration":0.0036014829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.492510+0000","last_change":"2023-06-23T18:50:49.492510+0000","last_active":"2023-06-23T18:50:49.492510+0000","last_peered":"2023-06-23T18:50:49.492510+0000","last_clean":"2023-06-23T18:50:49.492510+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:50:49.492510+0000","last_undegraded":"2023-06-23T18:50:49.492510+0000","last_fullsized":"2023-06-23T18:50:49.492510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.492191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:08:58.030503+0000","scrub_duration":0.003101272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.900695+0000","last_change":"2023-06-23T18:51:19.900936+0000","last_active":"2023-06-23T18:51:19.900695+0000","last_peered":"2023-06-23T18:51:19.900695+0000","last_clean":"2023-06-23T18:51:19.900695+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:51:19.900695+0000","last_undegraded":"2023-06-23T18:51:19.900695+0000","last_fullsized":"2023-06-23T18:51:19.900695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.900449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.900449+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.900449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:49.100534+0000","scrub_duration":0.0041921440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.518698+0000","last_change":"2023-06-23T18:51:12.518698+0000","last_active":"2023-06-23T18:51:12.518698+0000","last_peered":"2023-06-23T18:51:12.518698+0000","last_clean":"2023-06-23T18:51:12.518698+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:51:12.518698+0000","last_undegraded":"2023-06-23T18:51:12.518698+0000","last_fullsized":"2023-06-23T18:51:12.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.518378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:23.705690+0000","scrub_duration":0.003859594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.534195+0000","last_change":"2023-06-23T18:50:52.534195+0000","last_active":"2023-06-23T18:50:52.534195+0000","last_peered":"2023-06-23T18:50:52.534195+0000","last_clean":"2023-06-23T18:50:52.534195+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:50:52.534195+0000","last_undegraded":"2023-06-23T18:50:52.534195+0000","last_fullsized":"2023-06-23T18:50:52.534195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.533877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:49.679167+0000","scrub_duration":0.0032420919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:43.232656+0000","last_change":"2023-06-23T18:50:43.232656+0000","last_active":"2023-06-23T18:50:43.232656+0000","last_peered":"2023-06-23T18:50:43.232656+0000","last_clean":"2023-06-23T18:50:43.232656+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:50:43.232656+0000","last_undegraded":"2023-06-23T18:50:43.232656+0000","last_fullsized":"2023-06-23T18:50:43.232656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_clean_scrub_stamp":"2023-06-23T18:50:43.232516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:25.567882+0000","scrub_duration":0.0029476870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.802953+0000","last_change":"2023-06-23T18:51:19.803087+0000","last_active":"2023-06-23T18:51:19.802953+0000","last_peered":"2023-06-23T18:51:19.802953+0000","last_clean":"2023-06-23T18:51:19.802953+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:51:19.802953+0000","last_undegraded":"2023-06-23T18:51:19.802953+0000","last_fullsized":"2023-06-23T18:51:19.802953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.802756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.802756+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.802756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:49:07.715165+0000","scrub_duration":0.0039659049999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.497325+0000","last_change":"2023-06-23T18:51:06.497325+0000","last_active":"2023-06-23T18:51:06.497325+0000","last_peered":"2023-06-23T18:51:06.497325+0000","last_clean":"2023-06-23T18:51:06.497325+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:51:06.497325+0000","last_undegraded":"2023-06-23T18:51:06.497325+0000","last_fullsized":"2023-06-23T18:51:06.497325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.497010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.050436+0000","scrub_duration":0.003339449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:45.885555+0000","last_change":"2023-06-23T18:50:45.885555+0000","last_active":"2023-06-23T18:50:45.885555+0000","last_peered":"2023-06-23T18:50:45.885555+0000","last_clean":"2023-06-23T18:50:45.885555+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:50:45.885555+0000","last_undegraded":"2023-06-23T18:50:45.885555+0000","last_fullsized":"2023-06-23T18:50:45.885555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_clean_scrub_stamp":"2023-06-23T18:50:45.885234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.476258+0000","scrub_duration":0.0032745949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.725601+0000","last_change":"2023-06-23T18:51:18.725601+0000","last_active":"2023-06-23T18:51:18.725601+0000","last_peered":"2023-06-23T18:51:18.725601+0000","last_clean":"2023-06-23T18:51:18.725601+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:51:18.725601+0000","last_undegraded":"2023-06-23T18:51:18.725601+0000","last_fullsized":"2023-06-23T18:51:18.725601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.725283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:21:09.554309+0000","scrub_duration":0.0038159040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.952996+0000","last_change":"2023-06-23T18:51:21.953175+0000","last_active":"2023-06-23T18:51:21.952996+0000","last_peered":"2023-06-23T18:51:21.952996+0000","last_clean":"2023-06-23T18:51:21.952996+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:51:21.952996+0000","last_undegraded":"2023-06-23T18:51:21.952996+0000","last_fullsized":"2023-06-23T18:51:21.952996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.952780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.952780+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.952780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:35.154470+0000","scrub_duration":0.0040124649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.527616+0000","last_change":"2023-06-23T18:51:17.527707+0000","last_active":"2023-06-23T18:51:17.527616+0000","last_peered":"2023-06-23T18:51:17.527616+0000","last_clean":"2023-06-23T18:51:17.527616+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:51:17.527616+0000","last_undegraded":"2023-06-23T18:51:17.527616+0000","last_fullsized":"2023-06-23T18:51:17.527616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.527411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.223355+0000","scrub_duration":0.0037119330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:59.619897+0000","last_change":"2023-06-23T18:50:59.619897+0000","last_active":"2023-06-23T18:50:59.619897+0000","last_peered":"2023-06-23T18:50:59.619897+0000","last_clean":"2023-06-23T18:50:59.619897+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:50:59.619897+0000","last_undegraded":"2023-06-23T18:50:59.619897+0000","last_fullsized":"2023-06-23T18:50:59.619897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_clean_scrub_stamp":"2023-06-23T18:50:59.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:40:36.386104+0000","scrub_duration":0.0065439850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.029369+0000","last_change":"2023-06-23T18:50:46.029369+0000","last_active":"2023-06-23T18:50:46.029369+0000","last_peered":"2023-06-23T18:50:46.029369+0000","last_clean":"2023-06-23T18:50:46.029369+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:50:46.029369+0000","last_undegraded":"2023-06-23T18:50:46.029369+0000","last_fullsized":"2023-06-23T18:50:46.029369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.028949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.619973+0000","scrub_duration":0.0030831489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:20.043854+0000","last_change":"2023-06-23T18:51:20.044086+0000","last_active":"2023-06-23T18:51:20.043854+0000","last_peered":"2023-06-23T18:51:20.043854+0000","last_clean":"2023-06-23T18:51:20.043854+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:51:20.043854+0000","last_undegraded":"2023-06-23T18:51:20.043854+0000","last_fullsized":"2023-06-23T18:51:20.043854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:20.043635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:20.043635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:20.043635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:49.243720+0000","scrub_duration":0.0040941240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.471377+0000","last_change":"2023-06-23T18:51:33.471469+0000","last_active":"2023-06-23T18:51:33.471377+0000","last_peered":"2023-06-23T18:51:33.471377+0000","last_clean":"2023-06-23T18:51:33.471377+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:51:33.471377+0000","last_undegraded":"2023-06-23T18:51:33.471377+0000","last_fullsized":"2023-06-23T18:51:33.471377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.471167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.471167+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.471167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:44.831239+0000","scrub_duration":0.0032469650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.504828+0000","last_change":"2023-06-23T18:50:50.504828+0000","last_active":"2023-06-23T18:50:50.504828+0000","last_peered":"2023-06-23T18:50:50.504828+0000","last_clean":"2023-06-23T18:50:50.504828+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:50:50.504828+0000","last_undegraded":"2023-06-23T18:50:50.504828+0000","last_fullsized":"2023-06-23T18:50:50.504828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.504552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:37.616116+0000","scrub_duration":0.0037428470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.681337+0000","last_change":"2023-06-23T18:51:12.681337+0000","last_active":"2023-06-23T18:51:12.681337+0000","last_peered":"2023-06-23T18:51:12.681337+0000","last_clean":"2023-06-23T18:51:12.681337+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:51:12.681337+0000","last_undegraded":"2023-06-23T18:51:12.681337+0000","last_fullsized":"2023-06-23T18:51:12.681337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.681001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:33.106167+0000","scrub_duration":0.0069918799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302358+0000","last_change":"2023-06-23T18:49:40.828666+0000","last_active":"2023-06-23T18:49:44.302358+0000","last_peered":"2023-06-23T18:49:44.302358+0000","last_clean":"2023-06-23T18:49:44.302358+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:49:44.302358+0000","last_undegraded":"2023-06-23T18:49:44.302358+0000","last_fullsized":"2023-06-23T18:49:44.302358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.953346+0000","last_change":"2023-06-23T18:51:35.953346+0000","last_active":"2023-06-23T18:51:35.953346+0000","last_peered":"2023-06-23T18:51:35.953346+0000","last_clean":"2023-06-23T18:51:35.953346+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:51:35.953346+0000","last_undegraded":"2023-06-23T18:51:35.953346+0000","last_fullsized":"2023-06-23T18:51:35.953346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.952875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.952875+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.952875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:13:40.189949+0000","scrub_duration":0.0036270130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.877755+0000","last_change":"2023-06-23T18:51:14.877755+0000","last_active":"2023-06-23T18:51:14.877755+0000","last_peered":"2023-06-23T18:51:14.877755+0000","last_clean":"2023-06-23T18:51:14.877755+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:51:14.877755+0000","last_undegraded":"2023-06-23T18:51:14.877755+0000","last_fullsized":"2023-06-23T18:51:14.877755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.877419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:02.034083+0000","scrub_duration":0.00389647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.698763+0000","last_change":"2023-06-23T18:51:10.698763+0000","last_active":"2023-06-23T18:51:10.698763+0000","last_peered":"2023-06-23T18:51:10.698763+0000","last_clean":"2023-06-23T18:51:10.698763+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:51:10.698763+0000","last_undegraded":"2023-06-23T18:51:10.698763+0000","last_fullsized":"2023-06-23T18:51:10.698763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.698412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:37:53.107746+0000","scrub_duration":0.0035457790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.397477+0000","last_change":"2023-06-23T18:50:55.397477+0000","last_active":"2023-06-23T18:50:55.397477+0000","last_peered":"2023-06-23T18:50:55.397477+0000","last_clean":"2023-06-23T18:50:55.397477+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:50:55.397477+0000","last_undegraded":"2023-06-23T18:50:55.397477+0000","last_fullsized":"2023-06-23T18:50:55.397477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.397147+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:51:58.950573+0000","scrub_duration":0.013609326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.909402+0000","last_change":"2023-06-23T18:51:21.909534+0000","last_active":"2023-06-23T18:51:21.909402+0000","last_peered":"2023-06-23T18:51:21.909402+0000","last_clean":"2023-06-23T18:51:21.909402+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:51:21.909402+0000","last_undegraded":"2023-06-23T18:51:21.909402+0000","last_fullsized":"2023-06-23T18:51:21.909402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.909198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.909198+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.909198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:35.110888+0000","scrub_duration":0.0037866039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.885176+0000","last_change":"2023-06-23T18:51:06.885266+0000","last_active":"2023-06-23T18:51:06.885176+0000","last_peered":"2023-06-23T18:51:06.885176+0000","last_clean":"2023-06-23T18:51:06.885176+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:51:06.885176+0000","last_undegraded":"2023-06-23T18:51:06.885176+0000","last_fullsized":"2023-06-23T18:51:06.885176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.884967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.438393+0000","scrub_duration":0.0029774070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.025578+0000","last_change":"2023-06-23T18:51:04.025678+0000","last_active":"2023-06-23T18:51:04.025578+0000","last_peered":"2023-06-23T18:51:04.025578+0000","last_clean":"2023-06-23T18:51:04.025578+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:51:04.025578+0000","last_undegraded":"2023-06-23T18:51:04.025578+0000","last_fullsized":"2023-06-23T18:51:04.025578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.025376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:14:45.646151+0000","scrub_duration":0.0033227130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302329+0000","last_change":"2023-06-23T18:49:40.856197+0000","last_active":"2023-06-23T18:49:44.302329+0000","last_peered":"2023-06-23T18:49:44.302329+0000","last_clean":"2023-06-23T18:49:44.302329+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:49:44.302329+0000","last_undegraded":"2023-06-23T18:49:44.302329+0000","last_fullsized":"2023-06-23T18:49:44.302329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.846376+0000","last_change":"2023-06-23T18:51:10.846543+0000","last_active":"2023-06-23T18:51:10.846376+0000","last_peered":"2023-06-23T18:51:10.846376+0000","last_clean":"2023-06-23T18:51:10.846376+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:51:10.846376+0000","last_undegraded":"2023-06-23T18:51:10.846376+0000","last_fullsized":"2023-06-23T18:51:10.846376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.846070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:57.313464+0000","scrub_duration":0.003130163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:32.911529+0000","last_change":"2023-06-23T18:51:32.911631+0000","last_active":"2023-06-23T18:51:32.911529+0000","last_peered":"2023-06-23T18:51:32.911529+0000","last_clean":"2023-06-23T18:51:32.911529+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:51:32.911529+0000","last_undegraded":"2023-06-23T18:51:32.911529+0000","last_fullsized":"2023-06-23T18:51:32.911529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:32.911328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:32.911328+0000","last_clean_scrub_stamp":"2023-06-23T18:51:32.911328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:45:47.924339+0000","scrub_duration":0.0036059859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.996570+0000","last_change":"2023-06-23T18:51:33.996709+0000","last_active":"2023-06-23T18:51:33.996570+0000","last_peered":"2023-06-23T18:51:33.996570+0000","last_clean":"2023-06-23T18:51:33.996570+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:51:33.996570+0000","last_undegraded":"2023-06-23T18:51:33.996570+0000","last_fullsized":"2023-06-23T18:51:33.996570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.996356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.996356+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.996356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:21.153020+0000","scrub_duration":0.0040940919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.797511+0000","last_change":"2023-06-23T18:50:50.797602+0000","last_active":"2023-06-23T18:50:50.797511+0000","last_peered":"2023-06-23T18:50:50.797511+0000","last_clean":"2023-06-23T18:50:50.797511+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:50:50.797511+0000","last_undegraded":"2023-06-23T18:50:50.797511+0000","last_fullsized":"2023-06-23T18:50:50.797511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.797299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:30:37.953962+0000","scrub_duration":0.0033459710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.784633+0000","last_change":"2023-06-23T18:50:58.784725+0000","last_active":"2023-06-23T18:50:58.784633+0000","last_peered":"2023-06-23T18:50:58.784633+0000","last_clean":"2023-06-23T18:50:58.784633+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:50:58.784633+0000","last_undegraded":"2023-06-23T18:50:58.784633+0000","last_fullsized":"2023-06-23T18:50:58.784633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.784419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:02.814290+0000","scrub_duration":0.0033385580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:34.513862+0000","last_change":"2023-06-23T18:51:34.513997+0000","last_active":"2023-06-23T18:51:34.513862+0000","last_peered":"2023-06-23T18:51:34.513862+0000","last_clean":"2023-06-23T18:51:34.513862+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:51:34.513862+0000","last_undegraded":"2023-06-23T18:51:34.513862+0000","last_fullsized":"2023-06-23T18:51:34.513862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:34.513670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:34.513670+0000","last_clean_scrub_stamp":"2023-06-23T18:51:34.513670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:27.569028+0000","scrub_duration":0.0040561699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.830793+0000","last_change":"2023-06-23T18:51:12.830893+0000","last_active":"2023-06-23T18:51:12.830793+0000","last_peered":"2023-06-23T18:51:12.830793+0000","last_clean":"2023-06-23T18:51:12.830793+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:51:12.830793+0000","last_undegraded":"2023-06-23T18:51:12.830793+0000","last_fullsized":"2023-06-23T18:51:12.830793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.830505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.017818+0000","scrub_duration":0.003381111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.058715+0000","last_change":"2023-06-23T18:50:49.058838+0000","last_active":"2023-06-23T18:50:49.058715+0000","last_peered":"2023-06-23T18:50:49.058715+0000","last_clean":"2023-06-23T18:50:49.058715+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:50:49.058715+0000","last_undegraded":"2023-06-23T18:50:49.058715+0000","last_fullsized":"2023-06-23T18:50:49.058715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.058507+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.393874+0000","scrub_duration":0.0062727069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.063112+0000","last_change":"2023-06-23T18:51:18.063242+0000","last_active":"2023-06-23T18:51:18.063112+0000","last_peered":"2023-06-23T18:51:18.063112+0000","last_clean":"2023-06-23T18:51:18.063112+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:51:18.063112+0000","last_undegraded":"2023-06-23T18:51:18.063112+0000","last_fullsized":"2023-06-23T18:51:18.063112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.062909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.758852+0000","scrub_duration":0.0036211770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.658267+0000","last_change":"2023-06-23T18:51:02.658426+0000","last_active":"2023-06-23T18:51:02.658267+0000","last_peered":"2023-06-23T18:51:02.658267+0000","last_clean":"2023-06-23T18:51:02.658267+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:51:02.658267+0000","last_undegraded":"2023-06-23T18:51:02.658267+0000","last_fullsized":"2023-06-23T18:51:02.658267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.657999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:30:45.392084+0000","scrub_duration":0.0031540729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:48.953800+0000","last_change":"2023-06-23T18:50:48.953903+0000","last_active":"2023-06-23T18:50:48.953800+0000","last_peered":"2023-06-23T18:50:48.953800+0000","last_clean":"2023-06-23T18:50:48.953800+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:50:48.953800+0000","last_undegraded":"2023-06-23T18:50:48.953800+0000","last_fullsized":"2023-06-23T18:50:48.953800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_clean_scrub_stamp":"2023-06-23T18:50:48.953602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.288968+0000","scrub_duration":0.0038302459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.639782+0000","last_change":"2023-06-23T18:51:26.639919+0000","last_active":"2023-06-23T18:51:26.639782+0000","last_peered":"2023-06-23T18:51:26.639782+0000","last_clean":"2023-06-23T18:51:26.639782+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:51:26.639782+0000","last_undegraded":"2023-06-23T18:51:26.639782+0000","last_fullsized":"2023-06-23T18:51:26.639782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.639571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.639571+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.639571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:50:00.693704+0000","scrub_duration":0.0040308460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.857866+0000","last_change":"2023-06-23T18:51:21.857962+0000","last_active":"2023-06-23T18:51:21.857866+0000","last_peered":"2023-06-23T18:51:21.857866+0000","last_clean":"2023-06-23T18:51:21.857866+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:51:21.857866+0000","last_undegraded":"2023-06-23T18:51:21.857866+0000","last_fullsized":"2023-06-23T18:51:21.857866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.857625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.857625+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.857625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:55.911757+0000","scrub_duration":0.00313072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.805977+0000","last_change":"2023-06-23T18:50:54.806099+0000","last_active":"2023-06-23T18:50:54.805977+0000","last_peered":"2023-06-23T18:50:54.805977+0000","last_clean":"2023-06-23T18:50:54.805977+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:50:54.805977+0000","last_undegraded":"2023-06-23T18:50:54.805977+0000","last_fullsized":"2023-06-23T18:50:54.805977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.805774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:15:14.043224+0000","scrub_duration":0.0073158950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:40.476733+0000","last_change":"2023-06-23T18:51:40.476961+0000","last_active":"2023-06-23T18:51:40.476733+0000","last_peered":"2023-06-23T18:51:40.476733+0000","last_clean":"2023-06-23T18:51:40.476733+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:51:40.476733+0000","last_undegraded":"2023-06-23T18:51:40.476733+0000","last_fullsized":"2023-06-23T18:51:40.476733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:40.476516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:40.476516+0000","last_clean_scrub_stamp":"2023-06-23T18:51:40.476516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:34:21.263395+0000","scrub_duration":0.0041897920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.158176+0000","last_change":"2023-06-23T18:51:10.158286+0000","last_active":"2023-06-23T18:51:10.158176+0000","last_peered":"2023-06-23T18:51:10.158176+0000","last_clean":"2023-06-23T18:51:10.158176+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:51:10.158176+0000","last_undegraded":"2023-06-23T18:51:10.158176+0000","last_fullsized":"2023-06-23T18:51:10.158176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.157958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:23.359647+0000","scrub_duration":0.0038438600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.262886+0000","last_change":"2023-06-23T18:50:47.263007+0000","last_active":"2023-06-23T18:50:47.262886+0000","last_peered":"2023-06-23T18:50:47.262886+0000","last_clean":"2023-06-23T18:50:47.262886+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:50:47.262886+0000","last_undegraded":"2023-06-23T18:50:47.262886+0000","last_fullsized":"2023-06-23T18:50:47.262886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.262681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:34.374245+0000","scrub_duration":0.0065258790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:31.722775+0000","last_change":"2023-06-23T18:51:31.722925+0000","last_active":"2023-06-23T18:51:31.722775+0000","last_peered":"2023-06-23T18:51:31.722775+0000","last_clean":"2023-06-23T18:51:31.722775+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:51:31.722775+0000","last_undegraded":"2023-06-23T18:51:31.722775+0000","last_fullsized":"2023-06-23T18:51:31.722775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:31.722575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:31.722575+0000","last_clean_scrub_stamp":"2023-06-23T18:51:31.722575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:26.034627+0000","scrub_duration":0.0040179049999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.764785+0000","last_change":"2023-06-23T18:51:01.764888+0000","last_active":"2023-06-23T18:51:01.764785+0000","last_peered":"2023-06-23T18:51:01.764785+0000","last_clean":"2023-06-23T18:51:01.764785+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:51:01.764785+0000","last_undegraded":"2023-06-23T18:51:01.764785+0000","last_fullsized":"2023-06-23T18:51:01.764785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.764540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:02.584944+0000","scrub_duration":0.0032137759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"28'2","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.000041+0000","last_change":"2023-06-23T18:50:50.000146+0000","last_active":"2023-06-23T18:50:50.000041+0000","last_peered":"2023-06-23T18:50:50.000041+0000","last_clean":"2023-06-23T18:50:50.000041+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:50:50.000041+0000","last_undegraded":"2023-06-23T18:50:50.000041+0000","last_fullsized":"2023-06-23T18:50:50.000041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.999846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.864462+0000","scrub_duration":0.0065858610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.996444+0000","last_change":"2023-06-23T18:51:30.996626+0000","last_active":"2023-06-23T18:51:30.996444+0000","last_peered":"2023-06-23T18:51:30.996444+0000","last_clean":"2023-06-23T18:51:30.996444+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:51:30.996444+0000","last_undegraded":"2023-06-23T18:51:30.996444+0000","last_fullsized":"2023-06-23T18:51:30.996444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.996233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.996233+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.996233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:49:31.188032+0000","scrub_duration":0.003721252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:49:44.302301+0000","last_change":"2023-06-23T18:49:40.846387+0000","last_active":"2023-06-23T18:49:44.302301+0000","last_peered":"2023-06-23T18:49:44.302301+0000","last_clean":"2023-06-23T18:49:44.302301+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:49:44.302301+0000","last_undegraded":"2023-06-23T18:49:44.302301+0000","last_fullsized":"2023-06-23T18:49:44.302301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:49:39.764000+0000","last_clean_scrub_stamp":"2023-06-23T18:49:39.764000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.261437+0000","last_change":"2023-06-23T18:51:04.261620+0000","last_active":"2023-06-23T18:51:04.261437+0000","last_peered":"2023-06-23T18:51:04.261437+0000","last_clean":"2023-06-23T18:51:04.261437+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:51:04.261437+0000","last_undegraded":"2023-06-23T18:51:04.261437+0000","last_fullsized":"2023-06-23T18:51:04.261437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.261136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:50.728530+0000","scrub_duration":0.011066975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.454299+0000","last_change":"2023-06-23T18:51:26.454407+0000","last_active":"2023-06-23T18:51:26.454299+0000","last_peered":"2023-06-23T18:51:26.454299+0000","last_clean":"2023-06-23T18:51:26.454299+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:51:26.454299+0000","last_undegraded":"2023-06-23T18:51:26.454299+0000","last_fullsized":"2023-06-23T18:51:26.454299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.454074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.454074+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.454074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:40.384197+0000","scrub_duration":0.0034144069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.750360+0000","last_change":"2023-06-23T18:51:33.750496+0000","last_active":"2023-06-23T18:51:33.750360+0000","last_peered":"2023-06-23T18:51:33.750360+0000","last_clean":"2023-06-23T18:51:33.750360+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:51:33.750360+0000","last_undegraded":"2023-06-23T18:51:33.750360+0000","last_fullsized":"2023-06-23T18:51:33.750360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.750130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.750130+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.750130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:38:16.159463+0000","scrub_duration":0.004202356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:28.824533+0000","last_change":"2023-06-23T18:51:28.824624+0000","last_active":"2023-06-23T18:51:28.824533+0000","last_peered":"2023-06-23T18:51:28.824533+0000","last_clean":"2023-06-23T18:51:28.824533+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:51:28.824533+0000","last_undegraded":"2023-06-23T18:51:28.824533+0000","last_fullsized":"2023-06-23T18:51:28.824533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:28.824317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:28.824317+0000","last_clean_scrub_stamp":"2023-06-23T18:51:28.824317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:35:55.915718+0000","scrub_duration":0.0032302260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.409783+0000","last_change":"2023-06-23T18:51:19.409871+0000","last_active":"2023-06-23T18:51:19.409783+0000","last_peered":"2023-06-23T18:51:19.409783+0000","last_clean":"2023-06-23T18:51:19.409783+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:51:19.409783+0000","last_undegraded":"2023-06-23T18:51:19.409783+0000","last_fullsized":"2023-06-23T18:51:19.409783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.409589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:58:04.291439+0000","scrub_duration":0.0031584650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.502252+0000","last_change":"2023-06-23T18:50:47.502356+0000","last_active":"2023-06-23T18:50:47.502252+0000","last_peered":"2023-06-23T18:50:47.502252+0000","last_clean":"2023-06-23T18:50:47.502252+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:50:47.502252+0000","last_undegraded":"2023-06-23T18:50:47.502252+0000","last_fullsized":"2023-06-23T18:50:47.502252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.502043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:29.837409+0000","scrub_duration":0.0040377850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.792097+0000","last_change":"2023-06-23T18:50:53.792192+0000","last_active":"2023-06-23T18:50:53.792097+0000","last_peered":"2023-06-23T18:50:53.792097+0000","last_clean":"2023-06-23T18:50:53.792097+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:50:53.792097+0000","last_undegraded":"2023-06-23T18:50:53.792097+0000","last_fullsized":"2023-06-23T18:50:53.792097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.791890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:31.408545+0000","scrub_duration":0.0032528520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:24.789362+0000","last_change":"2023-06-23T18:51:24.789541+0000","last_active":"2023-06-23T18:51:24.789362+0000","last_peered":"2023-06-23T18:51:24.789362+0000","last_clean":"2023-06-23T18:51:24.789362+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:51:24.789362+0000","last_undegraded":"2023-06-23T18:51:24.789362+0000","last_fullsized":"2023-06-23T18:51:24.789362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:24.789157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:24.789157+0000","last_clean_scrub_stamp":"2023-06-23T18:51:24.789157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:30:15.829578+0000","scrub_duration":0.0044123920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"28'4","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:31.877740+0000","last_change":"2023-06-23T18:51:31.877843+0000","last_active":"2023-06-23T18:51:31.877740+0000","last_peered":"2023-06-23T18:51:31.877740+0000","last_clean":"2023-06-23T18:51:31.877740+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:51:31.877740+0000","last_undegraded":"2023-06-23T18:51:31.877740+0000","last_fullsized":"2023-06-23T18:51:31.877740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-06-23T18:51:31.877545+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-06-23T18:51:31.877545+0000","last_clean_scrub_stamp":"2023-06-23T18:51:31.877545+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:30.936660+0000","scrub_duration":0.012813868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.522782+0000","last_change":"2023-06-23T18:51:15.522875+0000","last_active":"2023-06-23T18:51:15.522782+0000","last_peered":"2023-06-23T18:51:15.522782+0000","last_clean":"2023-06-23T18:51:15.522782+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:51:15.522782+0000","last_undegraded":"2023-06-23T18:51:15.522782+0000","last_fullsized":"2023-06-23T18:51:15.522782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.522580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:01.989974+0000","scrub_duration":0.0030724910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:40.986759+0000","last_change":"2023-06-23T18:51:40.986934+0000","last_active":"2023-06-23T18:51:40.986759+0000","last_peered":"2023-06-23T18:51:40.986759+0000","last_clean":"2023-06-23T18:51:40.986759+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:51:40.986759+0000","last_undegraded":"2023-06-23T18:51:40.986759+0000","last_fullsized":"2023-06-23T18:51:40.986759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:40.986459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:40.986459+0000","last_clean_scrub_stamp":"2023-06-23T18:51:40.986459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:00:35.154381+0000","scrub_duration":0.0039978369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.142650+0000","last_change":"2023-06-23T18:51:15.142650+0000","last_active":"2023-06-23T18:51:15.142650+0000","last_peered":"2023-06-23T18:51:15.142650+0000","last_clean":"2023-06-23T18:51:15.142650+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:51:15.142650+0000","last_undegraded":"2023-06-23T18:51:15.142650+0000","last_fullsized":"2023-06-23T18:51:15.142650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.142332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:49.196465+0000","scrub_duration":0.0037055650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.540803+0000","last_change":"2023-06-23T18:51:04.540803+0000","last_active":"2023-06-23T18:51:04.540803+0000","last_peered":"2023-06-23T18:51:04.540803+0000","last_clean":"2023-06-23T18:51:04.540803+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:51:04.540803+0000","last_undegraded":"2023-06-23T18:51:04.540803+0000","last_fullsized":"2023-06-23T18:51:04.540803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.540495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:25.678734+0000","scrub_duration":0.0032800960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.895594+0000","last_change":"2023-06-23T18:51:04.895594+0000","last_active":"2023-06-23T18:51:04.895594+0000","last_peered":"2023-06-23T18:51:04.895594+0000","last_clean":"2023-06-23T18:51:04.895594+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:51:04.895594+0000","last_undegraded":"2023-06-23T18:51:04.895594+0000","last_fullsized":"2023-06-23T18:51:04.895594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.895432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.033671+0000","scrub_duration":0.001770878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.367573+0000","last_change":"2023-06-23T18:51:18.367573+0000","last_active":"2023-06-23T18:51:18.367573+0000","last_peered":"2023-06-23T18:51:18.367573+0000","last_clean":"2023-06-23T18:51:18.367573+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:51:18.367573+0000","last_undegraded":"2023-06-23T18:51:18.367573+0000","last_fullsized":"2023-06-23T18:51:18.367573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.367192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:11.666258+0000","scrub_duration":0.0031402629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:03.673541+0000","last_change":"2023-06-23T18:51:03.673633+0000","last_active":"2023-06-23T18:51:03.673541+0000","last_peered":"2023-06-23T18:51:03.673541+0000","last_clean":"2023-06-23T18:51:03.673541+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:51:03.673541+0000","last_undegraded":"2023-06-23T18:51:03.673541+0000","last_fullsized":"2023-06-23T18:51:03.673541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_clean_scrub_stamp":"2023-06-23T18:51:03.673345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:05:45.269103+0000","scrub_duration":0.0037635910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:36.975562+0000","last_change":"2023-06-23T18:51:36.975675+0000","last_active":"2023-06-23T18:51:36.975562+0000","last_peered":"2023-06-23T18:51:36.975562+0000","last_clean":"2023-06-23T18:51:36.975562+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:51:36.975562+0000","last_undegraded":"2023-06-23T18:51:36.975562+0000","last_fullsized":"2023-06-23T18:51:36.975562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:36.975332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:36.975332+0000","last_clean_scrub_stamp":"2023-06-23T18:51:36.975332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:37.404465+0000","scrub_duration":0.0033843889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.901799+0000","last_change":"2023-06-23T18:51:04.901895+0000","last_active":"2023-06-23T18:51:04.901799+0000","last_peered":"2023-06-23T18:51:04.901799+0000","last_clean":"2023-06-23T18:51:04.901799+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:51:04.901799+0000","last_undegraded":"2023-06-23T18:51:04.901799+0000","last_fullsized":"2023-06-23T18:51:04.901799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.901580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.039820+0000","scrub_duration":0.0032852200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.172564+0000","last_change":"2023-06-23T18:50:53.172651+0000","last_active":"2023-06-23T18:50:53.172564+0000","last_peered":"2023-06-23T18:50:53.172564+0000","last_clean":"2023-06-23T18:50:53.172564+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:50:53.172564+0000","last_undegraded":"2023-06-23T18:50:53.172564+0000","last_fullsized":"2023-06-23T18:50:53.172564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.172373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:06.374063+0000","scrub_duration":0.0034361800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.118750+0000","last_change":"2023-06-23T18:51:19.118846+0000","last_active":"2023-06-23T18:51:19.118750+0000","last_peered":"2023-06-23T18:51:19.118750+0000","last_clean":"2023-06-23T18:51:19.118750+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:51:19.118750+0000","last_undegraded":"2023-06-23T18:51:19.118750+0000","last_fullsized":"2023-06-23T18:51:19.118750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.118478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:07:21.530071+0000","scrub_duration":0.0037465380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:57.128158+0000","last_change":"2023-06-23T18:50:57.128267+0000","last_active":"2023-06-23T18:50:57.128158+0000","last_peered":"2023-06-23T18:50:57.128158+0000","last_clean":"2023-06-23T18:50:57.128158+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:50:57.128158+0000","last_undegraded":"2023-06-23T18:50:57.128158+0000","last_fullsized":"2023-06-23T18:50:57.128158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_clean_scrub_stamp":"2023-06-23T18:50:57.127936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:31.182068+0000","scrub_duration":0.0033896339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.010216+0000","last_change":"2023-06-23T18:50:53.010312+0000","last_active":"2023-06-23T18:50:53.010216+0000","last_peered":"2023-06-23T18:50:53.010216+0000","last_clean":"2023-06-23T18:50:53.010216+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:50:53.010216+0000","last_undegraded":"2023-06-23T18:50:53.010216+0000","last_fullsized":"2023-06-23T18:50:53.010216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.010001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.121565+0000","scrub_duration":0.0034279800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.998799+0000","last_change":"2023-06-23T18:51:22.998993+0000","last_active":"2023-06-23T18:51:22.998799+0000","last_peered":"2023-06-23T18:51:22.998799+0000","last_clean":"2023-06-23T18:51:22.998799+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:51:22.998799+0000","last_undegraded":"2023-06-23T18:51:22.998799+0000","last_fullsized":"2023-06-23T18:51:22.998799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.998587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.998587+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.998587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:04.619361+0000","scrub_duration":0.0036465489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.135828+0000","last_change":"2023-06-23T18:51:16.135927+0000","last_active":"2023-06-23T18:51:16.135828+0000","last_peered":"2023-06-23T18:51:16.135828+0000","last_clean":"2023-06-23T18:51:16.135828+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:51:16.135828+0000","last_undegraded":"2023-06-23T18:51:16.135828+0000","last_fullsized":"2023-06-23T18:51:16.135828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.135626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:33.268963+0000","scrub_duration":0.0035515730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.392603+0000","last_change":"2023-06-23T18:51:21.392764+0000","last_active":"2023-06-23T18:51:21.392603+0000","last_peered":"2023-06-23T18:51:21.392603+0000","last_clean":"2023-06-23T18:51:21.392603+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:51:21.392603+0000","last_undegraded":"2023-06-23T18:51:21.392603+0000","last_fullsized":"2023-06-23T18:51:21.392603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.392373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:51:06.440447+0000","scrub_duration":0.00346124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.932243+0000","last_change":"2023-06-23T18:51:06.932333+0000","last_active":"2023-06-23T18:51:06.932243+0000","last_peered":"2023-06-23T18:51:06.932243+0000","last_clean":"2023-06-23T18:51:06.932243+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:51:06.932243+0000","last_undegraded":"2023-06-23T18:51:06.932243+0000","last_fullsized":"2023-06-23T18:51:06.932243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.932039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.485465+0000","scrub_duration":0.0035631550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.037999+0000","last_change":"2023-06-23T18:50:55.038156+0000","last_active":"2023-06-23T18:50:55.037999+0000","last_peered":"2023-06-23T18:50:55.037999+0000","last_clean":"2023-06-23T18:50:55.037999+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:50:55.037999+0000","last_undegraded":"2023-06-23T18:50:55.037999+0000","last_fullsized":"2023-06-23T18:50:55.037999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.037786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.318885+0000","scrub_duration":0.0033358239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.840672+0000","last_change":"2023-06-23T18:50:47.840761+0000","last_active":"2023-06-23T18:50:47.840672+0000","last_peered":"2023-06-23T18:50:47.840672+0000","last_clean":"2023-06-23T18:50:47.840672+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:50:47.840672+0000","last_undegraded":"2023-06-23T18:50:47.840672+0000","last_fullsized":"2023-06-23T18:50:47.840672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.840462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:48.032261+0000","scrub_duration":0.0036463200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.964011+0000","last_change":"2023-06-23T18:50:54.964106+0000","last_active":"2023-06-23T18:50:54.964011+0000","last_peered":"2023-06-23T18:50:54.964011+0000","last_clean":"2023-06-23T18:50:54.964011+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:50:54.964011+0000","last_undegraded":"2023-06-23T18:50:54.964011+0000","last_fullsized":"2023-06-23T18:50:54.964011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.244910+0000","scrub_duration":0.0037456719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:08.183756+0000","last_change":"2023-06-23T18:51:08.183847+0000","last_active":"2023-06-23T18:51:08.183756+0000","last_peered":"2023-06-23T18:51:08.183756+0000","last_clean":"2023-06-23T18:51:08.183756+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:51:08.183756+0000","last_undegraded":"2023-06-23T18:51:08.183756+0000","last_fullsized":"2023-06-23T18:51:08.183756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_clean_scrub_stamp":"2023-06-23T18:51:08.183558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:37.383643+0000","scrub_duration":0.003312274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.585486+0000","last_change":"2023-06-23T18:51:19.585577+0000","last_active":"2023-06-23T18:51:19.585486+0000","last_peered":"2023-06-23T18:51:19.585486+0000","last_clean":"2023-06-23T18:51:19.585486+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:51:19.585486+0000","last_undegraded":"2023-06-23T18:51:19.585486+0000","last_fullsized":"2023-06-23T18:51:19.585486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.585278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.585278+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.585278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:48.785363+0000","scrub_duration":0.0035514539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.569431+0000","last_change":"2023-06-23T18:50:49.569592+0000","last_active":"2023-06-23T18:50:49.569431+0000","last_peered":"2023-06-23T18:50:49.569431+0000","last_clean":"2023-06-23T18:50:49.569431+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:50:49.569431+0000","last_undegraded":"2023-06-23T18:50:49.569431+0000","last_fullsized":"2023-06-23T18:50:49.569431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.569200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:29:53.991735+0000","scrub_duration":0.0038698320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.353794+0000","last_change":"2023-06-23T18:50:53.353850+0000","last_active":"2023-06-23T18:50:53.353794+0000","last_peered":"2023-06-23T18:50:53.353794+0000","last_clean":"2023-06-23T18:50:53.353794+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:50:53.353794+0000","last_undegraded":"2023-06-23T18:50:53.353794+0000","last_fullsized":"2023-06-23T18:50:53.353794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.353661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:14.491900+0000","scrub_duration":0.0026633910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:24.990508+0000","last_change":"2023-06-23T18:51:24.990634+0000","last_active":"2023-06-23T18:51:24.990508+0000","last_peered":"2023-06-23T18:51:24.990508+0000","last_clean":"2023-06-23T18:51:24.990508+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:51:24.990508+0000","last_undegraded":"2023-06-23T18:51:24.990508+0000","last_fullsized":"2023-06-23T18:51:24.990508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:24.990262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:24.990262+0000","last_clean_scrub_stamp":"2023-06-23T18:51:24.990262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:00.009550+0000","scrub_duration":0.0037393579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.249294+0000","last_change":"2023-06-23T18:50:44.249389+0000","last_active":"2023-06-23T18:50:44.249294+0000","last_peered":"2023-06-23T18:50:44.249294+0000","last_clean":"2023-06-23T18:50:44.249294+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:50:44.249294+0000","last_undegraded":"2023-06-23T18:50:44.249294+0000","last_fullsized":"2023-06-23T18:50:44.249294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.249097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:55.436409+0000","scrub_duration":0.0034108699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:20.105029+0000","last_change":"2023-06-23T18:51:20.105118+0000","last_active":"2023-06-23T18:51:20.105029+0000","last_peered":"2023-06-23T18:51:20.105029+0000","last_clean":"2023-06-23T18:51:20.105029+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:51:20.105029+0000","last_undegraded":"2023-06-23T18:51:20.105029+0000","last_fullsized":"2023-06-23T18:51:20.105029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:20.104830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:20.104830+0000","last_clean_scrub_stamp":"2023-06-23T18:51:20.104830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:58.801775+0000","scrub_duration":0.0032870960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:42.904789+0000","last_change":"2023-06-23T18:50:42.904856+0000","last_active":"2023-06-23T18:50:42.904789+0000","last_peered":"2023-06-23T18:50:42.904789+0000","last_clean":"2023-06-23T18:50:42.904789+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:50:42.904789+0000","last_undegraded":"2023-06-23T18:50:42.904789+0000","last_fullsized":"2023-06-23T18:50:42.904789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_clean_scrub_stamp":"2023-06-23T18:50:42.904670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:59.196272+0000","scrub_duration":0.001431545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.850052+0000","last_change":"2023-06-23T18:50:44.850145+0000","last_active":"2023-06-23T18:50:44.850052+0000","last_peered":"2023-06-23T18:50:44.850052+0000","last_clean":"2023-06-23T18:50:44.850052+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:50:44.850052+0000","last_undegraded":"2023-06-23T18:50:44.850052+0000","last_fullsized":"2023-06-23T18:50:44.850052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.849822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:57:45.611206+0000","scrub_duration":0.0040367679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.818626+0000","last_change":"2023-06-23T18:51:16.818729+0000","last_active":"2023-06-23T18:51:16.818626+0000","last_peered":"2023-06-23T18:51:16.818626+0000","last_clean":"2023-06-23T18:51:16.818626+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:51:16.818626+0000","last_undegraded":"2023-06-23T18:51:16.818626+0000","last_fullsized":"2023-06-23T18:51:16.818626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.818400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:54.435055+0000","scrub_duration":0.0031917149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.841885+0000","last_change":"2023-06-23T18:51:15.841885+0000","last_active":"2023-06-23T18:51:15.841885+0000","last_peered":"2023-06-23T18:51:15.841885+0000","last_clean":"2023-06-23T18:51:15.841885+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:51:15.841885+0000","last_undegraded":"2023-06-23T18:51:15.841885+0000","last_fullsized":"2023-06-23T18:51:15.841885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.308974+0000","scrub_duration":0.0037383379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.889932+0000","last_change":"2023-06-23T18:51:17.889932+0000","last_active":"2023-06-23T18:51:17.889932+0000","last_peered":"2023-06-23T18:51:17.889932+0000","last_clean":"2023-06-23T18:51:17.889932+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:51:17.889932+0000","last_undegraded":"2023-06-23T18:51:17.889932+0000","last_fullsized":"2023-06-23T18:51:17.889932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.889533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.585477+0000","scrub_duration":0.0036828059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.864247+0000","last_change":"2023-06-23T18:51:14.864247+0000","last_active":"2023-06-23T18:51:14.864247+0000","last_peered":"2023-06-23T18:51:14.864247+0000","last_clean":"2023-06-23T18:51:14.864247+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:51:14.864247+0000","last_undegraded":"2023-06-23T18:51:14.864247+0000","last_fullsized":"2023-06-23T18:51:14.864247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.863822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:39:19.677369+0000","scrub_duration":0.0039650900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.522861+0000","last_change":"2023-06-23T18:51:10.522861+0000","last_active":"2023-06-23T18:51:10.522861+0000","last_peered":"2023-06-23T18:51:10.522861+0000","last_clean":"2023-06-23T18:51:10.522861+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:51:10.522861+0000","last_undegraded":"2023-06-23T18:51:10.522861+0000","last_fullsized":"2023-06-23T18:51:10.522861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.522471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:29:37.879654+0000","scrub_duration":0.0033039380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6334,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.129,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.022},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.871,"15min":0.879},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.248,"15min":1.248},"last":0.98699999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.871,"15min":0.872},"min":{"1min":0.72099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0669999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1950000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.68700000000000006,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1950000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2410000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.89600000000000002}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92300000000000004,"15min":0.92200000000000004},"min":{"1min":0.77400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2829999999999999,"5min":1.327,"15min":1.327},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98999999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93700000000000006,"15min":0.93899999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0620000000000001,"15min":1.0820000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2030000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.1799999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.105,"15min":1.117},"min":{"1min":0.79600000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.345,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.179}]}]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.87}]},{"osd":1,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91800000000000004,"15min":0.91000000000000003},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.95199999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98099999999999998,"15min":0.98999999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.218,"5min":1.589,"15min":1.589},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98599999999999999,"15min":0.98499999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.266,"5min":1.496,"15min":1.496},"last":1.0309999999999999}]},{"osd":3,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1299999999999999,"5min":1.143,"15min":1.143},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1619999999999999,"5min":1.569,"15min":1.569},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0800000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3740000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.246,"5min":1.472,"15min":1.472},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.262,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.2090000000000001,"15min":1.22},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.454,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.119,"15min":1.131},"min":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.615,"15min":1.615},"last":1.052},{"interface":"front","average":{"1min":1.145,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.4299999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.0089999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.97899999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.04,"5min":1.054,"15min":1.054},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1379999999999999,"5min":1.26,"15min":1.26},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.081,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.159},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.056,"5min":1.337,"15min":1.337},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89400000000000002},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1479999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.125}]},{"osd":5,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.006,"15min":1.002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.282,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.056},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0089999999999999,"15min":1.012},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.274,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0780000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.802,"15min":1.802},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.052,"15min":1.0509999999999999},"min":{"1min":0.70699999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3120000000000001,"5min":1.879,"15min":1.879},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.022,"5min":1.026,"15min":1.0269999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3180000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0289999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.90400000000000003,"5min":1.54,"15min":1.54},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.99399999999999999,"5min":1.097,"15min":1.097},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0009999999999999,"5min":1.044,"15min":1.044},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0469999999999999,"5min":1.052,"15min":1.052},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.093}]},{"osd":5,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.70899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.234,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.05},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.995,"15min":1.0069999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1870000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":1.0660000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.097},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.7969999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3240000000000001,"5min":1.583,"15min":1.583},"last":1.2929999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.125,"5min":1.373,"15min":1.373},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0640000000000001,"5min":1.097,"15min":1.097},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45200000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0509999999999999,"5min":1.214,"15min":1.214},"last":0.879}]},{"osd":4,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96799999999999997,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2609999999999999,"5min":1.544,"15min":1.544},"last":1.111},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.98299999999999998,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.5349999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":0.97399999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2290000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.626,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3360000000000001,"5min":1.627,"15min":1.627},"last":1.2789999999999999}]},{"osd":6,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3069999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.175,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.3839999999999999}]},{"osd":7,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0740000000000001,"15min":1.091},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.212,"5min":1.986,"15min":1.986},"last":1.194},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.266,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.4330000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84999999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.01,"5min":1.226,"15min":1.226},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0209999999999999,"5min":1.288,"15min":1.288},"last":0.747}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71099999999999997,"15min":0.69199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.232,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.075}]},{"osd":5,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.879,"15min":0.877},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3100000000000001,"5min":1.444,"15min":1.444},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58099999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.071,"5min":1.468,"15min":1.468},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.94299999999999995,"15min":0.93799999999999994},"min":{"1min":0.69399999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1779999999999999,"5min":1.593,"15min":1.593},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.032,"15min":1.032},"min":{"1min":0.73599999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.492,"15min":1.492},"last":1.032},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.018,"15min":1.0369999999999999},"min":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.123,"5min":1.732,"15min":1.732},"last":1.006}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.224,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.046},{"interface":"front","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.014},"min":{"1min":0.82299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.242,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.995,"5min":1.331,"15min":1.331},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89100000000000001,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.173,"5min":1.196,"15min":1.196},"last":0.877}]},{"osd":2,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.875,"15min":0.86699999999999999},"min":{"1min":0.66700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1930000000000001,"5min":1.204,"15min":1.204},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1599999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.82399999999999995},"min":{"1min":0.67900000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.155,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.80400000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.93799999999999994}]},{"osd":4,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.93700000000000006,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.224,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.032,"15min":1.0229999999999999},"min":{"1min":0.78900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.995,"5min":1.0620000000000001,"15min":1.073},"min":{"1min":0.63600000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.03},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.91300000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4370000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.28},{"interface":"front","average":{"1min":0.879,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70199999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.198,"15min":1.198},"last":1.1040000000000001}]},{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.624,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.075,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.71499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.079,"5min":1.504,"15min":1.504},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":0.85599999999999998}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94199999999999995,"15min":0.95199999999999996},"min":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1519999999999999,"5min":1.274,"15min":1.274},"last":1.371},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96799999999999997,"15min":0.96999999999999997},"min":{"1min":0.78900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.127,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.5780000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.88600000000000001,"15min":0.88800000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1339999999999999,"5min":1.159,"15min":1.159},"last":1.329},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95499999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.23,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.4330000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.2390000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.032,"15min":1.03},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.27,"5min":1.407,"15min":1.407},"last":1.4990000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98499999999999999},"min":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.1539999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.179},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1060000000000001,"15min":1.1200000000000001},"min":{"1min":0.85699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.1919999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.54}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:51:45.735 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:45.736 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:45.737 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:45.737 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-23T18:49:39.764000+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=49, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=23, tm_hour=18, tm_min=50, tm_sec=39, tm_wday=4, tm_yday=174, tm_isdst=0) 2023-06-23T18:51:45.738 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-23T18:51:53.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:53.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:53.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:53.740 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:53.743 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:05.740 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:52:05.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 Processor -- start 2023-06-23T18:52:05.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 -- start start 2023-06-23T18:52:05.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26bc06d870 0x7f26bc06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26bc14b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc06be20 con 0x7f26bc148360 2023-06-23T18:52:05.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0714d0 con 0x7f26bc06d870 2023-06-23T18:52:05.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c274a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc14ae40 con 0x7f26bc071050 2023-06-23T18:52:05.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f26bc148360 0x7f26bc0be0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52900/0 (socket says 172.21.15.38:52900) 2023-06-23T18:52:05.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bbfff640 1 -- 172.21.15.38:0/3906836931 learned_addr learned my addr 172.21.15.38:0/3906836931 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:05.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/3906836931 >> v2:172.21.15.81:3300/0 conn(0x7f26bc06d870 0x7f26bc06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c0ce7640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26bc14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138397409 0 0) 0x7f26bc06be20 con 0x7f26bc148360 2023-06-23T18:52:05.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a4003530 con 0x7f26bc148360 2023-06-23T18:52:05.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 648935393 0 0) 0x7f26a4003530 con 0x7f26bc148360 2023-06-23T18:52:05.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 msgr2=0x7f26bc14b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:05.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26bc14b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 >> v2:172.21.15.81:3300/0 conn(0x7f26bc06d870 msgr2=0x7f26bc06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:05.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 --2- 172.21.15.38:0/3906836931 >> v2:172.21.15.81:3300/0 conn(0x7f26bc06d870 0x7f26bc06ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0b62f0 con 0x7f26bc148360 2023-06-23T18:52:05.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7f26ac001a00 con 0x7f26bc148360 2023-06-23T18:52:05.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 >> v1:172.21.15.38:6789/0 conn(0x7f26bc148360 legacy=0x7f26bc0be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:05.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a4004d10 0x7f26a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc14ae40 con 0x7f26a4003f00 2023-06-23T18:52:05.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a400dba0 con 0x7f26a4004d10 2023-06-23T18:52:05.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a400dd10 con 0x7f26bc071050 2023-06-23T18:52:05.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bbfff640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26c0ce7640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a4004d10 0x7f26a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 -- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 msgr2=0x7f26a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:05.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc071050 0x7f26a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 -- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a4004d10 msgr2=0x7f26a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:05.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a4004d10 0x7f26a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.878+0000 7f26bb7fe640 1 -- 172.21.15.38:0/3906836931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4003530 con 0x7f26a4003f00 2023-06-23T18:52:05.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26a40047d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009ae0 tx=0x7f26b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a52bda2f3141af server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:05.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00a5570 con 0x7f26a4003f00 2023-06-23T18:52:05.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00a56d0 con 0x7f26a4003f00 2023-06-23T18:52:05.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26baffd640 1 -- 172.21.15.38:0/3906836931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00a5a80 con 0x7f26a4003f00 2023-06-23T18:52:05.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- 172.21.15.38:0/3906836931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 msgr2=0x7f26a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:05.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 --2- 172.21.15.38:0/3906836931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26a40047d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009ae0 tx=0x7f26b001ca30 comp rx=0 tx=0).stop 2023-06-23T18:52:05.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c0ce7640 1 -- 172.21.15.38:0/3906836931 reap_dead start 2023-06-23T18:52:05.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- 172.21.15.38:0/3906836931 shutdown_connections 2023-06-23T18:52:05.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- 172.21.15.38:0/3906836931 >> 172.21.15.38:0/3906836931 conn(0x7f26bc0c1ba0 msgr2=0x7f26bc0bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:05.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- 172.21.15.38:0/3906836931 shutdown_connections 2023-06-23T18:52:05.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- 172.21.15.38:0/3906836931 wait complete. 2023-06-23T18:52:05.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 Processor -- start 2023-06-23T18:52:05.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- start start 2023-06-23T18:52:05.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 0x7f26bc1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26bc13fd20 0x7f26bc1e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13cfc0 con 0x7f26a4003f00 2023-06-23T18:52:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13a020 con 0x7f26bc13fd20 2023-06-23T18:52:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c274a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc13eb40 con 0x7f26bc13b6f0 2023-06-23T18:52:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34714/0 (socket says 172.21.15.38:34714) 2023-06-23T18:52:05.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 -- 172.21.15.38:0/1551497974 learned_addr learned my addr 172.21.15.38:0/1551497974 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:05.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 0x7f26bc1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26c0ce7640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26bc13fd20 0x7f26bc1e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 -- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 msgr2=0x7f26bc1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 0x7f26bc1401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 -- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26bc13fd20 msgr2=0x7f26bc1e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26bc13fd20 0x7f26bc1e5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bbfff640 1 -- 172.21.15.38:0/1551497974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc1e6e20 con 0x7f26a4003f00 2023-06-23T18:52:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.882+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 0x7f26bc1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:52:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26bbfff640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f26ac007b30 tx=0x7f26ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00edf0 con 0x7f26a4003f00 2023-06-23T18:52:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac013420 con 0x7f26a4003f00 2023-06-23T18:52:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc13c970 con 0x7f26a4003f00 2023-06-23T18:52:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0137d0 con 0x7f26a4003f00 2023-06-23T18:52:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc1e6150 con 0x7f26a4003f00 2023-06-23T18:52:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc04d790 con 0x7f26a4003f00 2023-06-23T18:52:05.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26ac013930 con 0x7f26a4003f00 2023-06-23T18:52:05.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 0x7f26a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:05.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f26ac0847a0 con 0x7f26a4003f00 2023-06-23T18:52:05.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 0x7f26a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:05.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.886+0000 7f26bb7fe640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 0x7f26a8068760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26b00af000 tx=0x7f26b00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:05.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:05.890+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26ac055450 con 0x7f26a4003f00 2023-06-23T18:52:06.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.042+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 --> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26bc14bb30 con 0x7f26a80662b0 2023-06-23T18:52:06.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.070+0000 7f26b8ff9640 1 -- 172.21.15.38:0/1551497974 <== mgr.4100 v2:172.21.15.81:6832/3176118993 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392674 (secure 0 0 0) 0x7f26b00a5840 con 0x7f26a80662b0 2023-06-23T18:52:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:52:06.085 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-06-23T18:52:06.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.074+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 msgr2=0x7f26a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.074+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 0x7f26a8068760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26b00af000 tx=0x7f26b00046d0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.074+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 msgr2=0x7f26bc1e68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.074+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f26ac007b30 tx=0x7f26ac00e530 comp rx=0 tx=0).stop 2023-06-23T18:52:06.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 shutdown_connections 2023-06-23T18:52:06.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f26a80662b0 0x7f26a8068760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26bc13fd20 0x7f26bc1e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26bc13b6f0 0x7f26bc1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 --2- 172.21.15.38:0/1551497974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a4003f00 0x7f26bc1e68e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 >> 172.21.15.38:0/1551497974 conn(0x7f26bc0c1ba0 msgr2=0x7f26bc0bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 shutdown_connections 2023-06-23T18:52:06.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.078+0000 7f26c274a640 1 -- 172.21.15.38:0/1551497974 wait complete. 2023-06-23T18:52:06.101 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-06-23T18:52:05.332434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596702,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740216,"statfs":{"total":773094113280,"available":772853981184,"internally_reserved":0,"allocated":2564096,"data_stored":2162460,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005180"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.725690+0000","last_change":"2023-06-23T18:51:35.725876+0000","last_active":"2023-06-23T18:51:35.725690+0000","last_peered":"2023-06-23T18:51:35.725690+0000","last_clean":"2023-06-23T18:51:35.725690+0000","last_became_active":"2023-06-23T18:49:40.816989+0000","last_became_peered":"2023-06-23T18:49:40.816989+0000","last_unstale":"2023-06-23T18:51:35.725690+0000","last_undegraded":"2023-06-23T18:51:35.725690+0000","last_fullsized":"2023-06-23T18:51:35.725690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.725477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.725477+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.725477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:56.150643+0000","scrub_duration":0.0043453010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"28'6","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.630354+0000","last_change":"2023-06-23T18:51:01.630354+0000","last_active":"2023-06-23T18:51:01.630354+0000","last_peered":"2023-06-23T18:51:01.630354+0000","last_clean":"2023-06-23T18:51:01.630354+0000","last_became_active":"2023-06-23T18:49:36.397403+0000","last_became_peered":"2023-06-23T18:49:36.397403+0000","last_unstale":"2023-06-23T18:51:01.630354+0000","last_undegraded":"2023-06-23T18:51:01.630354+0000","last_fullsized":"2023-06-23T18:51:01.630354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-06-23T18:51:01.629955+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.629955+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:47:56.036543+0000","scrub_duration":0.0081086479999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.908647+0000","last_change":"2023-06-23T18:51:30.908647+0000","last_active":"2023-06-23T18:51:30.908647+0000","last_peered":"2023-06-23T18:51:30.908647+0000","last_clean":"2023-06-23T18:51:30.908647+0000","last_became_active":"2023-06-23T18:49:36.815991+0000","last_became_peered":"2023-06-23T18:49:36.815991+0000","last_unstale":"2023-06-23T18:51:30.908647+0000","last_undegraded":"2023-06-23T18:51:30.908647+0000","last_fullsized":"2023-06-23T18:51:30.908647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.908354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.908354+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.908354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:05.927642+0000","scrub_duration":0.003561107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.017642+0000","last_change":"2023-06-23T18:51:35.017788+0000","last_active":"2023-06-23T18:51:35.017642+0000","last_peered":"2023-06-23T18:51:35.017642+0000","last_clean":"2023-06-23T18:51:35.017642+0000","last_became_active":"2023-06-23T18:49:40.856744+0000","last_became_peered":"2023-06-23T18:49:40.856744+0000","last_unstale":"2023-06-23T18:51:35.017642+0000","last_undegraded":"2023-06-23T18:51:35.017642+0000","last_fullsized":"2023-06-23T18:51:35.017642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.017419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.017419+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.017419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:16:35.826826+0000","scrub_duration":0.0040819259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.589921+0000","last_change":"2023-06-23T18:50:58.589921+0000","last_active":"2023-06-23T18:50:58.589921+0000","last_peered":"2023-06-23T18:50:58.589921+0000","last_clean":"2023-06-23T18:50:58.589921+0000","last_became_active":"2023-06-23T18:49:36.385558+0000","last_became_peered":"2023-06-23T18:49:36.385558+0000","last_unstale":"2023-06-23T18:50:58.589921+0000","last_undegraded":"2023-06-23T18:50:58.589921+0000","last_fullsized":"2023-06-23T18:50:58.589921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:50:58.589589+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.589589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:03:39.052945+0000","scrub_duration":0.0036881570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.023931+0000","last_change":"2023-06-23T18:50:50.023931+0000","last_active":"2023-06-23T18:50:50.023931+0000","last_peered":"2023-06-23T18:50:50.023931+0000","last_clean":"2023-06-23T18:50:50.023931+0000","last_became_active":"2023-06-23T18:49:36.775987+0000","last_became_peered":"2023-06-23T18:49:36.775987+0000","last_unstale":"2023-06-23T18:50:50.023931+0000","last_undegraded":"2023-06-23T18:50:50.023931+0000","last_fullsized":"2023-06-23T18:50:50.023931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.023624+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.023624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.888239+0000","scrub_duration":0.0031280280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:25.966208+0000","last_change":"2023-06-23T18:51:25.966356+0000","last_active":"2023-06-23T18:51:25.966208+0000","last_peered":"2023-06-23T18:51:25.966208+0000","last_clean":"2023-06-23T18:51:25.966208+0000","last_became_active":"2023-06-23T18:49:40.823495+0000","last_became_peered":"2023-06-23T18:49:40.823495+0000","last_unstale":"2023-06-23T18:51:25.966208+0000","last_undegraded":"2023-06-23T18:51:25.966208+0000","last_fullsized":"2023-06-23T18:51:25.966208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:25.965985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:25.965985+0000","last_clean_scrub_stamp":"2023-06-23T18:51:25.965985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:24.582093+0000","scrub_duration":0.0041428189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.794729+0000","last_change":"2023-06-23T18:50:52.794857+0000","last_active":"2023-06-23T18:50:52.794729+0000","last_peered":"2023-06-23T18:50:52.794729+0000","last_clean":"2023-06-23T18:50:52.794729+0000","last_became_active":"2023-06-23T18:49:36.396175+0000","last_became_peered":"2023-06-23T18:49:36.396175+0000","last_unstale":"2023-06-23T18:50:52.794729+0000","last_undegraded":"2023-06-23T18:50:52.794729+0000","last_fullsized":"2023-06-23T18:50:52.794729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:52.794494+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.794494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:15:53.603901+0000","scrub_duration":0.006501817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:00.074838+0000","last_change":"2023-06-23T18:51:00.074931+0000","last_active":"2023-06-23T18:51:00.074838+0000","last_peered":"2023-06-23T18:51:00.074838+0000","last_clean":"2023-06-23T18:51:00.074838+0000","last_became_active":"2023-06-23T18:49:36.771326+0000","last_became_peered":"2023-06-23T18:49:36.771326+0000","last_unstale":"2023-06-23T18:51:00.074838+0000","last_undegraded":"2023-06-23T18:51:00.074838+0000","last_fullsized":"2023-06-23T18:51:00.074838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:00.074635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:00.074635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:21.212875+0000","scrub_duration":0.003561402,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.000987+0000","last_change":"2023-06-23T18:51:27.001120+0000","last_active":"2023-06-23T18:51:27.000987+0000","last_peered":"2023-06-23T18:51:27.000987+0000","last_clean":"2023-06-23T18:51:27.000987+0000","last_became_active":"2023-06-23T18:49:40.855517+0000","last_became_peered":"2023-06-23T18:49:40.855517+0000","last_unstale":"2023-06-23T18:51:27.000987+0000","last_undegraded":"2023-06-23T18:51:27.000987+0000","last_fullsized":"2023-06-23T18:51:27.000987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.000765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.000765+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.000765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:58:27.762149+0000","scrub_duration":0.0036488359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.211877+0000","last_change":"2023-06-23T18:51:06.211982+0000","last_active":"2023-06-23T18:51:06.211877+0000","last_peered":"2023-06-23T18:51:06.211877+0000","last_clean":"2023-06-23T18:51:06.211877+0000","last_became_active":"2023-06-23T18:49:36.394524+0000","last_became_peered":"2023-06-23T18:49:36.394524+0000","last_unstale":"2023-06-23T18:51:06.211877+0000","last_undegraded":"2023-06-23T18:51:06.211877+0000","last_fullsized":"2023-06-23T18:51:06.211877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:06.211678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.211678+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:01.907622+0000","scrub_duration":0.0065308069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.905128+0000","last_change":"2023-06-23T18:51:17.905227+0000","last_active":"2023-06-23T18:51:17.905128+0000","last_peered":"2023-06-23T18:51:17.905128+0000","last_clean":"2023-06-23T18:51:17.905128+0000","last_became_active":"2023-06-23T18:49:36.789405+0000","last_became_peered":"2023-06-23T18:49:36.789405+0000","last_unstale":"2023-06-23T18:51:17.905128+0000","last_undegraded":"2023-06-23T18:51:17.905128+0000","last_fullsized":"2023-06-23T18:51:17.905128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.904924+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.904924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:31.106614+0000","scrub_duration":0.0037596510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.790864+0000","last_change":"2023-06-23T18:51:26.791102+0000","last_active":"2023-06-23T18:51:26.790864+0000","last_peered":"2023-06-23T18:51:26.790864+0000","last_clean":"2023-06-23T18:51:26.790864+0000","last_became_active":"2023-06-23T18:49:40.818387+0000","last_became_peered":"2023-06-23T18:49:40.818387+0000","last_unstale":"2023-06-23T18:51:26.790864+0000","last_undegraded":"2023-06-23T18:51:26.790864+0000","last_fullsized":"2023-06-23T18:51:26.790864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.790646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.790646+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.790646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:00:05.191923+0000","scrub_duration":0.0039504259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:11.933024+0000","last_change":"2023-06-23T18:51:11.933155+0000","last_active":"2023-06-23T18:51:11.933024+0000","last_peered":"2023-06-23T18:51:11.933024+0000","last_clean":"2023-06-23T18:51:11.933024+0000","last_became_active":"2023-06-23T18:49:36.388239+0000","last_became_peered":"2023-06-23T18:49:36.388239+0000","last_unstale":"2023-06-23T18:51:11.933024+0000","last_undegraded":"2023-06-23T18:51:11.933024+0000","last_fullsized":"2023-06-23T18:51:11.933024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:11.932789+0000","last_clean_scrub_stamp":"2023-06-23T18:51:11.932789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:49:12.124588+0000","scrub_duration":0.0036546809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.081975+0000","last_change":"2023-06-23T18:50:58.082067+0000","last_active":"2023-06-23T18:50:58.081975+0000","last_peered":"2023-06-23T18:50:58.081975+0000","last_clean":"2023-06-23T18:50:58.081975+0000","last_became_active":"2023-06-23T18:49:36.802325+0000","last_became_peered":"2023-06-23T18:49:36.802325+0000","last_unstale":"2023-06-23T18:50:58.081975+0000","last_undegraded":"2023-06-23T18:50:58.081975+0000","last_fullsized":"2023-06-23T18:50:58.081975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.081770+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.081770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:15.215107+0000","scrub_duration":0.0035039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.956524+0000","last_change":"2023-06-23T18:51:26.956718+0000","last_active":"2023-06-23T18:51:26.956524+0000","last_peered":"2023-06-23T18:51:26.956524+0000","last_clean":"2023-06-23T18:51:26.956524+0000","last_became_active":"2023-06-23T18:49:40.824935+0000","last_became_peered":"2023-06-23T18:49:40.824935+0000","last_unstale":"2023-06-23T18:51:26.956524+0000","last_undegraded":"2023-06-23T18:51:26.956524+0000","last_fullsized":"2023-06-23T18:51:26.956524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.956305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.956305+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.956305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:21.268357+0000","scrub_duration":0.003805891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.266030+0000","last_change":"2023-06-23T18:51:01.266147+0000","last_active":"2023-06-23T18:51:01.266030+0000","last_peered":"2023-06-23T18:51:01.266030+0000","last_clean":"2023-06-23T18:51:01.266030+0000","last_became_active":"2023-06-23T18:49:36.405441+0000","last_became_peered":"2023-06-23T18:49:36.405441+0000","last_unstale":"2023-06-23T18:51:01.266030+0000","last_undegraded":"2023-06-23T18:51:01.266030+0000","last_fullsized":"2023-06-23T18:51:01.266030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-06-23T18:51:01.265826+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.265826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:12.453139+0000","scrub_duration":0.0036297460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.027351+0000","last_change":"2023-06-23T18:51:16.027441+0000","last_active":"2023-06-23T18:51:16.027351+0000","last_peered":"2023-06-23T18:51:16.027351+0000","last_clean":"2023-06-23T18:51:16.027351+0000","last_became_active":"2023-06-23T18:49:36.793997+0000","last_became_peered":"2023-06-23T18:49:36.793997+0000","last_unstale":"2023-06-23T18:51:16.027351+0000","last_undegraded":"2023-06-23T18:51:16.027351+0000","last_fullsized":"2023-06-23T18:51:16.027351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.027155+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.027155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.494549+0000","scrub_duration":0.0033927509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:28.906846+0000","last_change":"2023-06-23T18:51:28.906846+0000","last_active":"2023-06-23T18:51:28.906846+0000","last_peered":"2023-06-23T18:51:28.906846+0000","last_clean":"2023-06-23T18:51:28.906846+0000","last_became_active":"2023-06-23T18:49:40.856520+0000","last_became_peered":"2023-06-23T18:49:40.856520+0000","last_unstale":"2023-06-23T18:51:28.906846+0000","last_undegraded":"2023-06-23T18:51:28.906846+0000","last_fullsized":"2023-06-23T18:51:28.906846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:28.906482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:28.906482+0000","last_clean_scrub_stamp":"2023-06-23T18:51:28.906482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:10.527257+0000","scrub_duration":0.0040950709999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.078956+0000","last_change":"2023-06-23T18:51:02.078956+0000","last_active":"2023-06-23T18:51:02.078956+0000","last_peered":"2023-06-23T18:51:02.078956+0000","last_clean":"2023-06-23T18:51:02.078956+0000","last_became_active":"2023-06-23T18:49:36.375649+0000","last_became_peered":"2023-06-23T18:49:36.375649+0000","last_unstale":"2023-06-23T18:51:02.078956+0000","last_undegraded":"2023-06-23T18:51:02.078956+0000","last_fullsized":"2023-06-23T18:51:02.078956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.078635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.078635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:53:56.390687+0000","scrub_duration":0.003585436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.211554+0000","last_change":"2023-06-23T18:50:50.211554+0000","last_active":"2023-06-23T18:50:50.211554+0000","last_peered":"2023-06-23T18:50:50.211554+0000","last_clean":"2023-06-23T18:50:50.211554+0000","last_became_active":"2023-06-23T18:49:36.803115+0000","last_became_peered":"2023-06-23T18:49:36.803115+0000","last_unstale":"2023-06-23T18:50:50.211554+0000","last_undegraded":"2023-06-23T18:50:50.211554+0000","last_fullsized":"2023-06-23T18:50:50.211554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.211152+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.211152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:38:55.024699+0000","scrub_duration":0.0034905040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.689058+0000","last_change":"2023-06-23T18:51:27.689058+0000","last_active":"2023-06-23T18:51:27.689058+0000","last_peered":"2023-06-23T18:51:27.689058+0000","last_clean":"2023-06-23T18:51:27.689058+0000","last_became_active":"2023-06-23T18:49:40.828673+0000","last_became_peered":"2023-06-23T18:49:40.828673+0000","last_unstale":"2023-06-23T18:51:27.689058+0000","last_undegraded":"2023-06-23T18:51:27.689058+0000","last_fullsized":"2023-06-23T18:51:27.689058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.688628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.688628+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.688628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:44.821965+0000","scrub_duration":0.0040759409999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.521469+0000","last_change":"2023-06-23T18:50:53.521469+0000","last_active":"2023-06-23T18:50:53.521469+0000","last_peered":"2023-06-23T18:50:53.521469+0000","last_clean":"2023-06-23T18:50:53.521469+0000","last_became_active":"2023-06-23T18:49:36.396526+0000","last_became_peered":"2023-06-23T18:49:36.396526+0000","last_unstale":"2023-06-23T18:50:53.521469+0000","last_undegraded":"2023-06-23T18:50:53.521469+0000","last_fullsized":"2023-06-23T18:50:53.521469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.521154+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.521154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:12:32.302169+0000","scrub_duration":0.0038767810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.834781+0000","last_change":"2023-06-23T18:50:55.834781+0000","last_active":"2023-06-23T18:50:55.834781+0000","last_peered":"2023-06-23T18:50:55.834781+0000","last_clean":"2023-06-23T18:50:55.834781+0000","last_became_active":"2023-06-23T18:49:36.779758+0000","last_became_peered":"2023-06-23T18:49:36.779758+0000","last_unstale":"2023-06-23T18:50:55.834781+0000","last_undegraded":"2023-06-23T18:50:55.834781+0000","last_fullsized":"2023-06-23T18:50:55.834781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.834438+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.834438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:19:22.644409+0000","scrub_duration":0.0035002900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:13.025201+0000","last_change":"2023-06-23T18:51:13.025201+0000","last_active":"2023-06-23T18:51:13.025201+0000","last_peered":"2023-06-23T18:51:13.025201+0000","last_clean":"2023-06-23T18:51:13.025201+0000","last_became_active":"2023-06-23T18:49:36.788868+0000","last_became_peered":"2023-06-23T18:49:36.788868+0000","last_unstale":"2023-06-23T18:51:13.025201+0000","last_undegraded":"2023-06-23T18:51:13.025201+0000","last_fullsized":"2023-06-23T18:51:13.025201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:13.024867+0000","last_clean_scrub_stamp":"2023-06-23T18:51:13.024867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.212180+0000","scrub_duration":0.0034090629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.566595+0000","last_change":"2023-06-23T18:50:54.566595+0000","last_active":"2023-06-23T18:50:54.566595+0000","last_peered":"2023-06-23T18:50:54.566595+0000","last_clean":"2023-06-23T18:50:54.566595+0000","last_became_active":"2023-06-23T18:49:36.392532+0000","last_became_peered":"2023-06-23T18:49:36.392532+0000","last_unstale":"2023-06-23T18:50:54.566595+0000","last_undegraded":"2023-06-23T18:50:54.566595+0000","last_fullsized":"2023-06-23T18:50:54.566595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.566209+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.566209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:15.460398+0000","scrub_duration":0.0040031069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:45.861414+0000","last_change":"2023-06-23T18:51:45.861414+0000","last_active":"2023-06-23T18:51:45.861414+0000","last_peered":"2023-06-23T18:51:45.861414+0000","last_clean":"2023-06-23T18:51:45.861414+0000","last_became_active":"2023-06-23T18:49:40.840121+0000","last_became_peered":"2023-06-23T18:49:40.840121+0000","last_unstale":"2023-06-23T18:51:45.861414+0000","last_undegraded":"2023-06-23T18:51:45.861414+0000","last_fullsized":"2023-06-23T18:51:45.861414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:45.861025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:45.861025+0000","last_clean_scrub_stamp":"2023-06-23T18:51:45.861025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:10:51.752547+0000","scrub_duration":0.0040477489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.195216+0000","last_change":"2023-06-23T18:50:46.195216+0000","last_active":"2023-06-23T18:50:46.195216+0000","last_peered":"2023-06-23T18:50:46.195216+0000","last_clean":"2023-06-23T18:50:46.195216+0000","last_became_active":"2023-06-23T18:49:36.802479+0000","last_became_peered":"2023-06-23T18:49:36.802479+0000","last_unstale":"2023-06-23T18:50:46.195216+0000","last_undegraded":"2023-06-23T18:50:46.195216+0000","last_fullsized":"2023-06-23T18:50:46.195216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.194901+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.194901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:05:11.372699+0000","scrub_duration":0.0039927290000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.242992+0000","last_change":"2023-06-23T18:50:44.242992+0000","last_active":"2023-06-23T18:50:44.242992+0000","last_peered":"2023-06-23T18:50:44.242992+0000","last_clean":"2023-06-23T18:50:44.242992+0000","last_became_active":"2023-06-23T18:49:36.394747+0000","last_became_peered":"2023-06-23T18:49:36.394747+0000","last_unstale":"2023-06-23T18:50:44.242992+0000","last_undegraded":"2023-06-23T18:50:44.242992+0000","last_fullsized":"2023-06-23T18:50:44.242992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.242702+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.242702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:35.107318+0000","scrub_duration":0.0033288580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.894505+0000","last_change":"2023-06-23T18:51:22.894505+0000","last_active":"2023-06-23T18:51:22.894505+0000","last_peered":"2023-06-23T18:51:22.894505+0000","last_clean":"2023-06-23T18:51:22.894505+0000","last_became_active":"2023-06-23T18:49:40.822594+0000","last_became_peered":"2023-06-23T18:49:40.822594+0000","last_unstale":"2023-06-23T18:51:22.894505+0000","last_undegraded":"2023-06-23T18:51:22.894505+0000","last_fullsized":"2023-06-23T18:51:22.894505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.894176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.894176+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.894176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:40.027513+0000","scrub_duration":0.0038051339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"28'5","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.922831+0000","last_change":"2023-06-23T18:50:52.922831+0000","last_active":"2023-06-23T18:50:52.922831+0000","last_peered":"2023-06-23T18:50:52.922831+0000","last_clean":"2023-06-23T18:50:52.922831+0000","last_became_active":"2023-06-23T18:49:36.400354+0000","last_became_peered":"2023-06-23T18:49:36.400354+0000","last_unstale":"2023-06-23T18:50:52.922831+0000","last_undegraded":"2023-06-23T18:50:52.922831+0000","last_fullsized":"2023-06-23T18:50:52.922831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2023-06-23T18:50:52.922501+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.922501+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.034066+0000","scrub_duration":0.0078325200000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.236534+0000","last_change":"2023-06-23T18:50:47.236534+0000","last_active":"2023-06-23T18:50:47.236534+0000","last_peered":"2023-06-23T18:50:47.236534+0000","last_clean":"2023-06-23T18:50:47.236534+0000","last_became_active":"2023-06-23T18:49:36.797178+0000","last_became_peered":"2023-06-23T18:49:36.797178+0000","last_unstale":"2023-06-23T18:50:47.236534+0000","last_undegraded":"2023-06-23T18:50:47.236534+0000","last_fullsized":"2023-06-23T18:50:47.236534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.236189+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.236189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:02:23.521561+0000","scrub_duration":0.003811432,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:27.814461+0000","last_change":"2023-06-23T18:51:27.814461+0000","last_active":"2023-06-23T18:51:27.814461+0000","last_peered":"2023-06-23T18:51:27.814461+0000","last_clean":"2023-06-23T18:51:27.814461+0000","last_became_active":"2023-06-23T18:49:40.829865+0000","last_became_peered":"2023-06-23T18:49:40.829865+0000","last_unstale":"2023-06-23T18:51:27.814461+0000","last_undegraded":"2023-06-23T18:51:27.814461+0000","last_fullsized":"2023-06-23T18:51:27.814461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:27.814084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:27.814084+0000","last_clean_scrub_stamp":"2023-06-23T18:51:27.814084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:32:19.699034+0000","scrub_duration":0.003688981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'20","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.706830+0000","last_change":"2023-06-23T18:51:04.706830+0000","last_active":"2023-06-23T18:51:04.706830+0000","last_peered":"2023-06-23T18:51:04.706830+0000","last_clean":"2023-06-23T18:51:04.706830+0000","last_became_active":"2023-06-23T18:49:36.393053+0000","last_became_peered":"2023-06-23T18:49:36.393053+0000","last_unstale":"2023-06-23T18:51:04.706830+0000","last_undegraded":"2023-06-23T18:51:04.706830+0000","last_fullsized":"2023-06-23T18:51:04.706830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2023-06-23T18:51:04.706637+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.706637+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:31:56.591587+0000","scrub_duration":0.0056771579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.030740+0000","last_change":"2023-06-23T18:51:02.030740+0000","last_active":"2023-06-23T18:51:02.030740+0000","last_peered":"2023-06-23T18:51:02.030740+0000","last_clean":"2023-06-23T18:51:02.030740+0000","last_became_active":"2023-06-23T18:49:36.767828+0000","last_became_peered":"2023-06-23T18:49:36.767828+0000","last_unstale":"2023-06-23T18:51:02.030740+0000","last_undegraded":"2023-06-23T18:51:02.030740+0000","last_fullsized":"2023-06-23T18:51:02.030740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.030409+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.030409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:05.583835+0000","scrub_duration":0.00380671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.718453+0000","last_change":"2023-06-23T18:51:30.718453+0000","last_active":"2023-06-23T18:51:30.718453+0000","last_peered":"2023-06-23T18:51:30.718453+0000","last_clean":"2023-06-23T18:51:30.718453+0000","last_became_active":"2023-06-23T18:49:40.840388+0000","last_became_peered":"2023-06-23T18:49:40.840388+0000","last_unstale":"2023-06-23T18:51:30.718453+0000","last_undegraded":"2023-06-23T18:51:30.718453+0000","last_fullsized":"2023-06-23T18:51:30.718453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.718116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.718116+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.718116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:29.334223+0000","scrub_duration":0.0043417129999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.940123+0000","last_change":"2023-06-23T18:51:07.940123+0000","last_active":"2023-06-23T18:51:07.940123+0000","last_peered":"2023-06-23T18:51:07.940123+0000","last_clean":"2023-06-23T18:51:07.940123+0000","last_became_active":"2023-06-23T18:49:36.769671+0000","last_became_peered":"2023-06-23T18:49:36.769671+0000","last_unstale":"2023-06-23T18:51:07.940123+0000","last_undegraded":"2023-06-23T18:51:07.940123+0000","last_fullsized":"2023-06-23T18:51:07.940123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:07.939690+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.939690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:19.127003+0000","scrub_duration":0.0034629029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.756658+0000","last_change":"2023-06-23T18:51:22.756658+0000","last_active":"2023-06-23T18:51:22.756658+0000","last_peered":"2023-06-23T18:51:22.756658+0000","last_clean":"2023-06-23T18:51:22.756658+0000","last_became_active":"2023-06-23T18:49:32.325702+0000","last_became_peered":"2023-06-23T18:49:32.325702+0000","last_unstale":"2023-06-23T18:51:22.756658+0000","last_undegraded":"2023-06-23T18:51:22.756658+0000","last_fullsized":"2023-06-23T18:51:22.756658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.756310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.756310+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.756310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:53:58.669588+0000","scrub_duration":0.0033271619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:05.937842+0000","last_change":"2023-06-23T18:51:05.937842+0000","last_active":"2023-06-23T18:51:05.937842+0000","last_peered":"2023-06-23T18:51:05.937842+0000","last_clean":"2023-06-23T18:51:05.937842+0000","last_became_active":"2023-06-23T18:49:36.377550+0000","last_became_peered":"2023-06-23T18:49:36.377550+0000","last_unstale":"2023-06-23T18:51:05.937842+0000","last_undegraded":"2023-06-23T18:51:05.937842+0000","last_fullsized":"2023-06-23T18:51:05.937842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:51:05.937431+0000","last_clean_scrub_stamp":"2023-06-23T18:51:05.937431+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:08:40.956719+0000","scrub_duration":0.006516399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.846661+0000","last_change":"2023-06-23T18:51:22.846661+0000","last_active":"2023-06-23T18:51:22.846661+0000","last_peered":"2023-06-23T18:51:22.846661+0000","last_clean":"2023-06-23T18:51:22.846661+0000","last_became_active":"2023-06-23T18:49:40.818328+0000","last_became_peered":"2023-06-23T18:49:40.818328+0000","last_unstale":"2023-06-23T18:51:22.846661+0000","last_undegraded":"2023-06-23T18:51:22.846661+0000","last_fullsized":"2023-06-23T18:51:22.846661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.846264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.846264+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.846264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:26.876135+0000","scrub_duration":0.0041846449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.859824+0000","last_change":"2023-06-23T18:51:15.859824+0000","last_active":"2023-06-23T18:51:15.859824+0000","last_peered":"2023-06-23T18:51:15.859824+0000","last_clean":"2023-06-23T18:51:15.859824+0000","last_became_active":"2023-06-23T18:49:36.796948+0000","last_became_peered":"2023-06-23T18:49:36.796948+0000","last_unstale":"2023-06-23T18:51:15.859824+0000","last_undegraded":"2023-06-23T18:51:15.859824+0000","last_fullsized":"2023-06-23T18:51:15.859824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.859533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.859533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:16:16.668940+0000","scrub_duration":0.0038012860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.108971+0000","last_change":"2023-06-23T18:51:01.108971+0000","last_active":"2023-06-23T18:51:01.108971+0000","last_peered":"2023-06-23T18:51:01.108971+0000","last_clean":"2023-06-23T18:51:01.108971+0000","last_became_active":"2023-06-23T18:49:32.315411+0000","last_became_peered":"2023-06-23T18:49:32.315411+0000","last_unstale":"2023-06-23T18:51:01.108971+0000","last_undegraded":"2023-06-23T18:51:01.108971+0000","last_fullsized":"2023-06-23T18:51:01.108971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.108678+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.108678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:49:59.724785+0000","scrub_duration":0.0037045720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:07.973434+0000","last_change":"2023-06-23T18:51:07.973434+0000","last_active":"2023-06-23T18:51:07.973434+0000","last_peered":"2023-06-23T18:51:07.973434+0000","last_clean":"2023-06-23T18:51:07.973434+0000","last_became_active":"2023-06-23T18:49:36.395037+0000","last_became_peered":"2023-06-23T18:49:36.395037+0000","last_unstale":"2023-06-23T18:51:07.973434+0000","last_undegraded":"2023-06-23T18:51:07.973434+0000","last_fullsized":"2023-06-23T18:51:07.973434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:51:07.973139+0000","last_clean_scrub_stamp":"2023-06-23T18:51:07.973139+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:58:08.734523+0000","scrub_duration":0.0064564239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:38.966728+0000","last_change":"2023-06-23T18:51:38.966728+0000","last_active":"2023-06-23T18:51:38.966728+0000","last_peered":"2023-06-23T18:51:38.966728+0000","last_clean":"2023-06-23T18:51:38.966728+0000","last_became_active":"2023-06-23T18:49:40.817996+0000","last_became_peered":"2023-06-23T18:49:40.817996+0000","last_unstale":"2023-06-23T18:51:38.966728+0000","last_undegraded":"2023-06-23T18:51:38.966728+0000","last_fullsized":"2023-06-23T18:51:38.966728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:38.966333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:38.966333+0000","last_clean_scrub_stamp":"2023-06-23T18:51:38.966333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:00:29.598121+0000","scrub_duration":0.00388318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.638471+0000","last_change":"2023-06-23T18:51:21.638471+0000","last_active":"2023-06-23T18:51:21.638471+0000","last_peered":"2023-06-23T18:51:21.638471+0000","last_clean":"2023-06-23T18:51:21.638471+0000","last_became_active":"2023-06-23T18:49:36.780055+0000","last_became_peered":"2023-06-23T18:49:36.780055+0000","last_unstale":"2023-06-23T18:51:21.638471+0000","last_undegraded":"2023-06-23T18:51:21.638471+0000","last_fullsized":"2023-06-23T18:51:21.638471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.638159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.638159+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.638159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:34.839849+0000","scrub_duration":0.0038764789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.727701+0000","last_change":"2023-06-23T18:51:16.727701+0000","last_active":"2023-06-23T18:51:16.727701+0000","last_peered":"2023-06-23T18:51:16.727701+0000","last_clean":"2023-06-23T18:51:16.727701+0000","last_became_active":"2023-06-23T18:49:32.327485+0000","last_became_peered":"2023-06-23T18:49:32.327485+0000","last_unstale":"2023-06-23T18:51:16.727701+0000","last_undegraded":"2023-06-23T18:51:16.727701+0000","last_fullsized":"2023-06-23T18:51:16.727701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.727396+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.727396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:37:21.123261+0000","scrub_duration":0.0036014829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.492510+0000","last_change":"2023-06-23T18:50:49.492510+0000","last_active":"2023-06-23T18:50:49.492510+0000","last_peered":"2023-06-23T18:50:49.492510+0000","last_clean":"2023-06-23T18:50:49.492510+0000","last_became_active":"2023-06-23T18:49:36.400427+0000","last_became_peered":"2023-06-23T18:49:36.400427+0000","last_unstale":"2023-06-23T18:50:49.492510+0000","last_undegraded":"2023-06-23T18:50:49.492510+0000","last_fullsized":"2023-06-23T18:50:49.492510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.492191+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.492191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:08:58.030503+0000","scrub_duration":0.003101272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.900936+0000","last_change":"2023-06-23T18:51:19.900936+0000","last_active":"2023-06-23T18:51:19.900936+0000","last_peered":"2023-06-23T18:51:19.900936+0000","last_clean":"2023-06-23T18:51:19.900936+0000","last_became_active":"2023-06-23T18:49:40.855586+0000","last_became_peered":"2023-06-23T18:49:40.855586+0000","last_unstale":"2023-06-23T18:51:19.900936+0000","last_undegraded":"2023-06-23T18:51:19.900936+0000","last_fullsized":"2023-06-23T18:51:19.900936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.900449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.900449+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.900449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:49.100534+0000","scrub_duration":0.0041921440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.518698+0000","last_change":"2023-06-23T18:51:12.518698+0000","last_active":"2023-06-23T18:51:12.518698+0000","last_peered":"2023-06-23T18:51:12.518698+0000","last_clean":"2023-06-23T18:51:12.518698+0000","last_became_active":"2023-06-23T18:49:36.768157+0000","last_became_peered":"2023-06-23T18:49:36.768157+0000","last_unstale":"2023-06-23T18:51:12.518698+0000","last_undegraded":"2023-06-23T18:51:12.518698+0000","last_fullsized":"2023-06-23T18:51:12.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.518378+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.518378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:23.705690+0000","scrub_duration":0.003859594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:52.534195+0000","last_change":"2023-06-23T18:50:52.534195+0000","last_active":"2023-06-23T18:50:52.534195+0000","last_peered":"2023-06-23T18:50:52.534195+0000","last_clean":"2023-06-23T18:50:52.534195+0000","last_became_active":"2023-06-23T18:49:32.675826+0000","last_became_peered":"2023-06-23T18:49:32.675826+0000","last_unstale":"2023-06-23T18:50:52.534195+0000","last_undegraded":"2023-06-23T18:50:52.534195+0000","last_fullsized":"2023-06-23T18:50:52.534195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:52.533877+0000","last_clean_scrub_stamp":"2023-06-23T18:50:52.533877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:49.679167+0000","scrub_duration":0.0032420919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:43.232656+0000","last_change":"2023-06-23T18:50:43.232656+0000","last_active":"2023-06-23T18:50:43.232656+0000","last_peered":"2023-06-23T18:50:43.232656+0000","last_clean":"2023-06-23T18:50:43.232656+0000","last_became_active":"2023-06-23T18:49:36.400910+0000","last_became_peered":"2023-06-23T18:49:36.400910+0000","last_unstale":"2023-06-23T18:50:43.232656+0000","last_undegraded":"2023-06-23T18:50:43.232656+0000","last_fullsized":"2023-06-23T18:50:43.232656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:43.232516+0000","last_clean_scrub_stamp":"2023-06-23T18:50:43.232516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:25.567882+0000","scrub_duration":0.0029476870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.803087+0000","last_change":"2023-06-23T18:51:19.803087+0000","last_active":"2023-06-23T18:51:19.803087+0000","last_peered":"2023-06-23T18:51:19.803087+0000","last_clean":"2023-06-23T18:51:19.803087+0000","last_became_active":"2023-06-23T18:49:40.825885+0000","last_became_peered":"2023-06-23T18:49:40.825885+0000","last_unstale":"2023-06-23T18:51:19.803087+0000","last_undegraded":"2023-06-23T18:51:19.803087+0000","last_fullsized":"2023-06-23T18:51:19.803087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.802756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.802756+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.802756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:49:07.715165+0000","scrub_duration":0.0039659049999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.497325+0000","last_change":"2023-06-23T18:51:06.497325+0000","last_active":"2023-06-23T18:51:06.497325+0000","last_peered":"2023-06-23T18:51:06.497325+0000","last_clean":"2023-06-23T18:51:06.497325+0000","last_became_active":"2023-06-23T18:49:36.790256+0000","last_became_peered":"2023-06-23T18:49:36.790256+0000","last_unstale":"2023-06-23T18:51:06.497325+0000","last_undegraded":"2023-06-23T18:51:06.497325+0000","last_fullsized":"2023-06-23T18:51:06.497325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.497010+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.497010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.050436+0000","scrub_duration":0.003339449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:45.885555+0000","last_change":"2023-06-23T18:50:45.885555+0000","last_active":"2023-06-23T18:50:45.885555+0000","last_peered":"2023-06-23T18:50:45.885555+0000","last_clean":"2023-06-23T18:50:45.885555+0000","last_became_active":"2023-06-23T18:49:36.388215+0000","last_became_peered":"2023-06-23T18:49:36.388215+0000","last_unstale":"2023-06-23T18:50:45.885555+0000","last_undegraded":"2023-06-23T18:50:45.885555+0000","last_fullsized":"2023-06-23T18:50:45.885555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:45.885234+0000","last_clean_scrub_stamp":"2023-06-23T18:50:45.885234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.476258+0000","scrub_duration":0.0032745949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.725601+0000","last_change":"2023-06-23T18:51:18.725601+0000","last_active":"2023-06-23T18:51:18.725601+0000","last_peered":"2023-06-23T18:51:18.725601+0000","last_clean":"2023-06-23T18:51:18.725601+0000","last_became_active":"2023-06-23T18:49:32.681288+0000","last_became_peered":"2023-06-23T18:49:32.681288+0000","last_unstale":"2023-06-23T18:51:18.725601+0000","last_undegraded":"2023-06-23T18:51:18.725601+0000","last_fullsized":"2023-06-23T18:51:18.725601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.725283+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.725283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:21:09.554309+0000","scrub_duration":0.0038159040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.953175+0000","last_change":"2023-06-23T18:51:21.953175+0000","last_active":"2023-06-23T18:51:21.953175+0000","last_peered":"2023-06-23T18:51:21.953175+0000","last_clean":"2023-06-23T18:51:21.953175+0000","last_became_active":"2023-06-23T18:49:40.840403+0000","last_became_peered":"2023-06-23T18:49:40.840403+0000","last_unstale":"2023-06-23T18:51:21.953175+0000","last_undegraded":"2023-06-23T18:51:21.953175+0000","last_fullsized":"2023-06-23T18:51:21.953175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.952780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.952780+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.952780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:35.154470+0000","scrub_duration":0.0040124649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.527707+0000","last_change":"2023-06-23T18:51:17.527707+0000","last_active":"2023-06-23T18:51:17.527707+0000","last_peered":"2023-06-23T18:51:17.527707+0000","last_clean":"2023-06-23T18:51:17.527707+0000","last_became_active":"2023-06-23T18:49:36.774313+0000","last_became_peered":"2023-06-23T18:49:36.774313+0000","last_unstale":"2023-06-23T18:51:17.527707+0000","last_undegraded":"2023-06-23T18:51:17.527707+0000","last_fullsized":"2023-06-23T18:51:17.527707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.527411+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.527411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.223355+0000","scrub_duration":0.0037119330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:59.619897+0000","last_change":"2023-06-23T18:50:59.619897+0000","last_active":"2023-06-23T18:50:59.619897+0000","last_peered":"2023-06-23T18:50:59.619897+0000","last_clean":"2023-06-23T18:50:59.619897+0000","last_became_active":"2023-06-23T18:49:36.385182+0000","last_became_peered":"2023-06-23T18:49:36.385182+0000","last_unstale":"2023-06-23T18:50:59.619897+0000","last_undegraded":"2023-06-23T18:50:59.619897+0000","last_fullsized":"2023-06-23T18:50:59.619897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:59.619581+0000","last_clean_scrub_stamp":"2023-06-23T18:50:59.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:40:36.386104+0000","scrub_duration":0.0065439850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:46.029369+0000","last_change":"2023-06-23T18:50:46.029369+0000","last_active":"2023-06-23T18:50:46.029369+0000","last_peered":"2023-06-23T18:50:46.029369+0000","last_clean":"2023-06-23T18:50:46.029369+0000","last_became_active":"2023-06-23T18:49:32.327382+0000","last_became_peered":"2023-06-23T18:49:32.327382+0000","last_unstale":"2023-06-23T18:50:46.029369+0000","last_undegraded":"2023-06-23T18:50:46.029369+0000","last_fullsized":"2023-06-23T18:50:46.029369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:46.028949+0000","last_clean_scrub_stamp":"2023-06-23T18:50:46.028949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:36.619973+0000","scrub_duration":0.0030831489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:20.044086+0000","last_change":"2023-06-23T18:51:20.044086+0000","last_active":"2023-06-23T18:51:20.044086+0000","last_peered":"2023-06-23T18:51:20.044086+0000","last_clean":"2023-06-23T18:51:20.044086+0000","last_became_active":"2023-06-23T18:49:40.820976+0000","last_became_peered":"2023-06-23T18:49:40.820976+0000","last_unstale":"2023-06-23T18:51:20.044086+0000","last_undegraded":"2023-06-23T18:51:20.044086+0000","last_fullsized":"2023-06-23T18:51:20.044086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:20.043635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:20.043635+0000","last_clean_scrub_stamp":"2023-06-23T18:51:20.043635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:49.243720+0000","scrub_duration":0.0040941240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.471469+0000","last_change":"2023-06-23T18:51:33.471469+0000","last_active":"2023-06-23T18:51:33.471469+0000","last_peered":"2023-06-23T18:51:33.471469+0000","last_clean":"2023-06-23T18:51:33.471469+0000","last_became_active":"2023-06-23T18:49:36.790762+0000","last_became_peered":"2023-06-23T18:49:36.790762+0000","last_unstale":"2023-06-23T18:51:33.471469+0000","last_undegraded":"2023-06-23T18:51:33.471469+0000","last_fullsized":"2023-06-23T18:51:33.471469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.471167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.471167+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.471167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:44.831239+0000","scrub_duration":0.0032469650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.504828+0000","last_change":"2023-06-23T18:50:50.504828+0000","last_active":"2023-06-23T18:50:50.504828+0000","last_peered":"2023-06-23T18:50:50.504828+0000","last_clean":"2023-06-23T18:50:50.504828+0000","last_became_active":"2023-06-23T18:49:36.394893+0000","last_became_peered":"2023-06-23T18:49:36.394893+0000","last_unstale":"2023-06-23T18:50:50.504828+0000","last_undegraded":"2023-06-23T18:50:50.504828+0000","last_fullsized":"2023-06-23T18:50:50.504828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.504552+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.504552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:37.616116+0000","scrub_duration":0.0037428470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.681337+0000","last_change":"2023-06-23T18:51:12.681337+0000","last_active":"2023-06-23T18:51:12.681337+0000","last_peered":"2023-06-23T18:51:12.681337+0000","last_clean":"2023-06-23T18:51:12.681337+0000","last_became_active":"2023-06-23T18:49:32.329906+0000","last_became_peered":"2023-06-23T18:49:32.329906+0000","last_unstale":"2023-06-23T18:51:12.681337+0000","last_undegraded":"2023-06-23T18:51:12.681337+0000","last_fullsized":"2023-06-23T18:51:12.681337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.681001+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.681001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:33.106167+0000","scrub_duration":0.0069918799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:51.779819+0000","last_change":"2023-06-23T18:51:51.779819+0000","last_active":"2023-06-23T18:51:51.779819+0000","last_peered":"2023-06-23T18:51:51.779819+0000","last_clean":"2023-06-23T18:51:51.779819+0000","last_became_active":"2023-06-23T18:49:40.827862+0000","last_became_peered":"2023-06-23T18:49:40.827862+0000","last_unstale":"2023-06-23T18:51:51.779819+0000","last_undegraded":"2023-06-23T18:51:51.779819+0000","last_fullsized":"2023-06-23T18:51:51.779819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:51.779396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:51.779396+0000","last_clean_scrub_stamp":"2023-06-23T18:51:51.779396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:13:08.743908+0000","scrub_duration":0.0037858079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:35.953346+0000","last_change":"2023-06-23T18:51:35.953346+0000","last_active":"2023-06-23T18:51:35.953346+0000","last_peered":"2023-06-23T18:51:35.953346+0000","last_clean":"2023-06-23T18:51:35.953346+0000","last_became_active":"2023-06-23T18:49:36.771970+0000","last_became_peered":"2023-06-23T18:49:36.771970+0000","last_unstale":"2023-06-23T18:51:35.953346+0000","last_undegraded":"2023-06-23T18:51:35.953346+0000","last_fullsized":"2023-06-23T18:51:35.953346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:35.952875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:35.952875+0000","last_clean_scrub_stamp":"2023-06-23T18:51:35.952875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:13:40.189949+0000","scrub_duration":0.0036270130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.877755+0000","last_change":"2023-06-23T18:51:14.877755+0000","last_active":"2023-06-23T18:51:14.877755+0000","last_peered":"2023-06-23T18:51:14.877755+0000","last_clean":"2023-06-23T18:51:14.877755+0000","last_became_active":"2023-06-23T18:49:36.381439+0000","last_became_peered":"2023-06-23T18:49:36.381439+0000","last_unstale":"2023-06-23T18:51:14.877755+0000","last_undegraded":"2023-06-23T18:51:14.877755+0000","last_fullsized":"2023-06-23T18:51:14.877755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.877419+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.877419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:02.034083+0000","scrub_duration":0.00389647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.698763+0000","last_change":"2023-06-23T18:51:10.698763+0000","last_active":"2023-06-23T18:51:10.698763+0000","last_peered":"2023-06-23T18:51:10.698763+0000","last_clean":"2023-06-23T18:51:10.698763+0000","last_became_active":"2023-06-23T18:49:32.489920+0000","last_became_peered":"2023-06-23T18:49:32.489920+0000","last_unstale":"2023-06-23T18:51:10.698763+0000","last_undegraded":"2023-06-23T18:51:10.698763+0000","last_fullsized":"2023-06-23T18:51:10.698763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.698412+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.698412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:37:53.107746+0000","scrub_duration":0.0035457790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":191,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.397477+0000","last_change":"2023-06-23T18:50:55.397477+0000","last_active":"2023-06-23T18:50:55.397477+0000","last_peered":"2023-06-23T18:50:55.397477+0000","last_clean":"2023-06-23T18:50:55.397477+0000","last_became_active":"2023-06-23T18:49:24.780495+0000","last_became_peered":"2023-06-23T18:49:24.780495+0000","last_unstale":"2023-06-23T18:50:55.397477+0000","last_undegraded":"2023-06-23T18:50:55.397477+0000","last_fullsized":"2023-06-23T18:50:55.397477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2023-06-23T18:50:55.397147+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.397147+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:51:58.950573+0000","scrub_duration":0.013609326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.909534+0000","last_change":"2023-06-23T18:51:21.909534+0000","last_active":"2023-06-23T18:51:21.909534+0000","last_peered":"2023-06-23T18:51:21.909534+0000","last_clean":"2023-06-23T18:51:21.909534+0000","last_became_active":"2023-06-23T18:49:40.835142+0000","last_became_peered":"2023-06-23T18:49:40.835142+0000","last_unstale":"2023-06-23T18:51:21.909534+0000","last_undegraded":"2023-06-23T18:51:21.909534+0000","last_fullsized":"2023-06-23T18:51:21.909534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.909198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.909198+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.909198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:35.110888+0000","scrub_duration":0.0037866039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.885266+0000","last_change":"2023-06-23T18:51:06.885266+0000","last_active":"2023-06-23T18:51:06.885266+0000","last_peered":"2023-06-23T18:51:06.885266+0000","last_clean":"2023-06-23T18:51:06.885266+0000","last_became_active":"2023-06-23T18:49:36.798742+0000","last_became_peered":"2023-06-23T18:49:36.798742+0000","last_unstale":"2023-06-23T18:51:06.885266+0000","last_undegraded":"2023-06-23T18:51:06.885266+0000","last_fullsized":"2023-06-23T18:51:06.885266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.884967+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.884967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.438393+0000","scrub_duration":0.0029774070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.025678+0000","last_change":"2023-06-23T18:51:04.025678+0000","last_active":"2023-06-23T18:51:04.025678+0000","last_peered":"2023-06-23T18:51:04.025678+0000","last_clean":"2023-06-23T18:51:04.025678+0000","last_became_active":"2023-06-23T18:49:36.375334+0000","last_became_peered":"2023-06-23T18:49:36.375334+0000","last_unstale":"2023-06-23T18:51:04.025678+0000","last_undegraded":"2023-06-23T18:51:04.025678+0000","last_fullsized":"2023-06-23T18:51:04.025678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.025376+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.025376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:14:45.646151+0000","scrub_duration":0.0033227130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:46.886094+0000","last_change":"2023-06-23T18:51:46.886094+0000","last_active":"2023-06-23T18:51:46.886094+0000","last_peered":"2023-06-23T18:51:46.886094+0000","last_clean":"2023-06-23T18:51:46.886094+0000","last_became_active":"2023-06-23T18:49:40.855753+0000","last_became_peered":"2023-06-23T18:49:40.855753+0000","last_unstale":"2023-06-23T18:51:46.886094+0000","last_undegraded":"2023-06-23T18:51:46.886094+0000","last_fullsized":"2023-06-23T18:51:46.886094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:46.885692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:46.885692+0000","last_clean_scrub_stamp":"2023-06-23T18:51:46.885692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:55:34.281959+0000","scrub_duration":0.0040556180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.846543+0000","last_change":"2023-06-23T18:51:10.846543+0000","last_active":"2023-06-23T18:51:10.846543+0000","last_peered":"2023-06-23T18:51:10.846543+0000","last_clean":"2023-06-23T18:51:10.846543+0000","last_became_active":"2023-06-23T18:49:36.768496+0000","last_became_peered":"2023-06-23T18:49:36.768496+0000","last_unstale":"2023-06-23T18:51:10.846543+0000","last_undegraded":"2023-06-23T18:51:10.846543+0000","last_fullsized":"2023-06-23T18:51:10.846543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.846070+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.846070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:57.313464+0000","scrub_duration":0.003130163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:32.911631+0000","last_change":"2023-06-23T18:51:32.911631+0000","last_active":"2023-06-23T18:51:32.911631+0000","last_peered":"2023-06-23T18:51:32.911631+0000","last_clean":"2023-06-23T18:51:32.911631+0000","last_became_active":"2023-06-23T18:49:36.393112+0000","last_became_peered":"2023-06-23T18:49:36.393112+0000","last_unstale":"2023-06-23T18:51:32.911631+0000","last_undegraded":"2023-06-23T18:51:32.911631+0000","last_fullsized":"2023-06-23T18:51:32.911631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:32.911328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:32.911328+0000","last_clean_scrub_stamp":"2023-06-23T18:51:32.911328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:45:47.924339+0000","scrub_duration":0.0036059859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.996709+0000","last_change":"2023-06-23T18:51:33.996709+0000","last_active":"2023-06-23T18:51:33.996709+0000","last_peered":"2023-06-23T18:51:33.996709+0000","last_clean":"2023-06-23T18:51:33.996709+0000","last_became_active":"2023-06-23T18:49:40.856989+0000","last_became_peered":"2023-06-23T18:49:40.856989+0000","last_unstale":"2023-06-23T18:51:33.996709+0000","last_undegraded":"2023-06-23T18:51:33.996709+0000","last_fullsized":"2023-06-23T18:51:33.996709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.996356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.996356+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.996356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:21.153020+0000","scrub_duration":0.0040940919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.797602+0000","last_change":"2023-06-23T18:50:50.797602+0000","last_active":"2023-06-23T18:50:50.797602+0000","last_peered":"2023-06-23T18:50:50.797602+0000","last_clean":"2023-06-23T18:50:50.797602+0000","last_became_active":"2023-06-23T18:49:36.772315+0000","last_became_peered":"2023-06-23T18:49:36.772315+0000","last_unstale":"2023-06-23T18:50:50.797602+0000","last_undegraded":"2023-06-23T18:50:50.797602+0000","last_fullsized":"2023-06-23T18:50:50.797602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:50.797299+0000","last_clean_scrub_stamp":"2023-06-23T18:50:50.797299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:30:37.953962+0000","scrub_duration":0.0033459710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:58.784725+0000","last_change":"2023-06-23T18:50:58.784725+0000","last_active":"2023-06-23T18:50:58.784725+0000","last_peered":"2023-06-23T18:50:58.784725+0000","last_clean":"2023-06-23T18:50:58.784725+0000","last_became_active":"2023-06-23T18:49:36.393008+0000","last_became_peered":"2023-06-23T18:49:36.393008+0000","last_unstale":"2023-06-23T18:50:58.784725+0000","last_undegraded":"2023-06-23T18:50:58.784725+0000","last_fullsized":"2023-06-23T18:50:58.784725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:58.784419+0000","last_clean_scrub_stamp":"2023-06-23T18:50:58.784419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:47:02.814290+0000","scrub_duration":0.0033385580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:34.513997+0000","last_change":"2023-06-23T18:51:34.513997+0000","last_active":"2023-06-23T18:51:34.513997+0000","last_peered":"2023-06-23T18:51:34.513997+0000","last_clean":"2023-06-23T18:51:34.513997+0000","last_became_active":"2023-06-23T18:49:40.843080+0000","last_became_peered":"2023-06-23T18:49:40.843080+0000","last_unstale":"2023-06-23T18:51:34.513997+0000","last_undegraded":"2023-06-23T18:51:34.513997+0000","last_fullsized":"2023-06-23T18:51:34.513997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:34.513670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:34.513670+0000","last_clean_scrub_stamp":"2023-06-23T18:51:34.513670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:40:27.569028+0000","scrub_duration":0.0040561699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:12.830893+0000","last_change":"2023-06-23T18:51:12.830893+0000","last_active":"2023-06-23T18:51:12.830893+0000","last_peered":"2023-06-23T18:51:12.830893+0000","last_clean":"2023-06-23T18:51:12.830893+0000","last_became_active":"2023-06-23T18:49:36.815234+0000","last_became_peered":"2023-06-23T18:49:36.815234+0000","last_unstale":"2023-06-23T18:51:12.830893+0000","last_undegraded":"2023-06-23T18:51:12.830893+0000","last_fullsized":"2023-06-23T18:51:12.830893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:12.830505+0000","last_clean_scrub_stamp":"2023-06-23T18:51:12.830505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:08:24.017818+0000","scrub_duration":0.003381111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.058838+0000","last_change":"2023-06-23T18:50:49.058838+0000","last_active":"2023-06-23T18:50:49.058838+0000","last_peered":"2023-06-23T18:50:49.058838+0000","last_clean":"2023-06-23T18:50:49.058838+0000","last_became_active":"2023-06-23T18:49:36.392719+0000","last_became_peered":"2023-06-23T18:49:36.392719+0000","last_unstale":"2023-06-23T18:50:49.058838+0000","last_undegraded":"2023-06-23T18:50:49.058838+0000","last_fullsized":"2023-06-23T18:50:49.058838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:49.058507+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.058507+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.393874+0000","scrub_duration":0.0062727069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.063242+0000","last_change":"2023-06-23T18:51:18.063242+0000","last_active":"2023-06-23T18:51:18.063242+0000","last_peered":"2023-06-23T18:51:18.063242+0000","last_clean":"2023-06-23T18:51:18.063242+0000","last_became_active":"2023-06-23T18:49:40.835265+0000","last_became_peered":"2023-06-23T18:49:40.835265+0000","last_unstale":"2023-06-23T18:51:18.063242+0000","last_undegraded":"2023-06-23T18:51:18.063242+0000","last_fullsized":"2023-06-23T18:51:18.063242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.062909+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.062909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.758852+0000","scrub_duration":0.0036211770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:02.658426+0000","last_change":"2023-06-23T18:51:02.658426+0000","last_active":"2023-06-23T18:51:02.658426+0000","last_peered":"2023-06-23T18:51:02.658426+0000","last_clean":"2023-06-23T18:51:02.658426+0000","last_became_active":"2023-06-23T18:49:36.811831+0000","last_became_peered":"2023-06-23T18:49:36.811831+0000","last_unstale":"2023-06-23T18:51:02.658426+0000","last_undegraded":"2023-06-23T18:51:02.658426+0000","last_fullsized":"2023-06-23T18:51:02.658426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:02.657999+0000","last_clean_scrub_stamp":"2023-06-23T18:51:02.657999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:30:45.392084+0000","scrub_duration":0.0031540729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:48.953903+0000","last_change":"2023-06-23T18:50:48.953903+0000","last_active":"2023-06-23T18:50:48.953903+0000","last_peered":"2023-06-23T18:50:48.953903+0000","last_clean":"2023-06-23T18:50:48.953903+0000","last_became_active":"2023-06-23T18:49:36.391984+0000","last_became_peered":"2023-06-23T18:49:36.391984+0000","last_unstale":"2023-06-23T18:50:48.953903+0000","last_undegraded":"2023-06-23T18:50:48.953903+0000","last_fullsized":"2023-06-23T18:50:48.953903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:48.953602+0000","last_clean_scrub_stamp":"2023-06-23T18:50:48.953602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:31.288968+0000","scrub_duration":0.0038302459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.639919+0000","last_change":"2023-06-23T18:51:26.639919+0000","last_active":"2023-06-23T18:51:26.639919+0000","last_peered":"2023-06-23T18:51:26.639919+0000","last_clean":"2023-06-23T18:51:26.639919+0000","last_became_active":"2023-06-23T18:49:40.843041+0000","last_became_peered":"2023-06-23T18:49:40.843041+0000","last_unstale":"2023-06-23T18:51:26.639919+0000","last_undegraded":"2023-06-23T18:51:26.639919+0000","last_fullsized":"2023-06-23T18:51:26.639919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.639571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.639571+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.639571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:50:00.693704+0000","scrub_duration":0.0040308460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.857962+0000","last_change":"2023-06-23T18:51:21.857962+0000","last_active":"2023-06-23T18:51:21.857962+0000","last_peered":"2023-06-23T18:51:21.857962+0000","last_clean":"2023-06-23T18:51:21.857962+0000","last_became_active":"2023-06-23T18:49:36.769584+0000","last_became_peered":"2023-06-23T18:49:36.769584+0000","last_unstale":"2023-06-23T18:51:21.857962+0000","last_undegraded":"2023-06-23T18:51:21.857962+0000","last_fullsized":"2023-06-23T18:51:21.857962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.857625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.857625+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.857625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:55.911757+0000","scrub_duration":0.00313072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.806099+0000","last_change":"2023-06-23T18:50:54.806099+0000","last_active":"2023-06-23T18:50:54.806099+0000","last_peered":"2023-06-23T18:50:54.806099+0000","last_clean":"2023-06-23T18:50:54.806099+0000","last_became_active":"2023-06-23T18:49:36.393458+0000","last_became_peered":"2023-06-23T18:49:36.393458+0000","last_unstale":"2023-06-23T18:50:54.806099+0000","last_undegraded":"2023-06-23T18:50:54.806099+0000","last_fullsized":"2023-06-23T18:50:54.806099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:54.805774+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.805774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:15:14.043224+0000","scrub_duration":0.0073158950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:40.476961+0000","last_change":"2023-06-23T18:51:40.476961+0000","last_active":"2023-06-23T18:51:40.476961+0000","last_peered":"2023-06-23T18:51:40.476961+0000","last_clean":"2023-06-23T18:51:40.476961+0000","last_became_active":"2023-06-23T18:49:40.849704+0000","last_became_peered":"2023-06-23T18:49:40.849704+0000","last_unstale":"2023-06-23T18:51:40.476961+0000","last_undegraded":"2023-06-23T18:51:40.476961+0000","last_fullsized":"2023-06-23T18:51:40.476961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:40.476516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:40.476516+0000","last_clean_scrub_stamp":"2023-06-23T18:51:40.476516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:34:21.263395+0000","scrub_duration":0.0041897920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.158286+0000","last_change":"2023-06-23T18:51:10.158286+0000","last_active":"2023-06-23T18:51:10.158286+0000","last_peered":"2023-06-23T18:51:10.158286+0000","last_clean":"2023-06-23T18:51:10.158286+0000","last_became_active":"2023-06-23T18:49:36.801502+0000","last_became_peered":"2023-06-23T18:49:36.801502+0000","last_unstale":"2023-06-23T18:51:10.158286+0000","last_undegraded":"2023-06-23T18:51:10.158286+0000","last_fullsized":"2023-06-23T18:51:10.158286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.157958+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.157958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:23.359647+0000","scrub_duration":0.0038438600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.263007+0000","last_change":"2023-06-23T18:50:47.263007+0000","last_active":"2023-06-23T18:50:47.263007+0000","last_peered":"2023-06-23T18:50:47.263007+0000","last_clean":"2023-06-23T18:50:47.263007+0000","last_became_active":"2023-06-23T18:49:36.395243+0000","last_became_peered":"2023-06-23T18:49:36.395243+0000","last_unstale":"2023-06-23T18:50:47.263007+0000","last_undegraded":"2023-06-23T18:50:47.263007+0000","last_fullsized":"2023-06-23T18:50:47.263007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2023-06-23T18:50:47.262681+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.262681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:34.374245+0000","scrub_duration":0.0065258790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:31.722925+0000","last_change":"2023-06-23T18:51:31.722925+0000","last_active":"2023-06-23T18:51:31.722925+0000","last_peered":"2023-06-23T18:51:31.722925+0000","last_clean":"2023-06-23T18:51:31.722925+0000","last_became_active":"2023-06-23T18:49:40.841148+0000","last_became_peered":"2023-06-23T18:49:40.841148+0000","last_unstale":"2023-06-23T18:51:31.722925+0000","last_undegraded":"2023-06-23T18:51:31.722925+0000","last_fullsized":"2023-06-23T18:51:31.722925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:31.722575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:31.722575+0000","last_clean_scrub_stamp":"2023-06-23T18:51:31.722575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:26.034627+0000","scrub_duration":0.0040179049999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:01.764888+0000","last_change":"2023-06-23T18:51:01.764888+0000","last_active":"2023-06-23T18:51:01.764888+0000","last_peered":"2023-06-23T18:51:01.764888+0000","last_clean":"2023-06-23T18:51:01.764888+0000","last_became_active":"2023-06-23T18:49:36.767628+0000","last_became_peered":"2023-06-23T18:49:36.767628+0000","last_unstale":"2023-06-23T18:51:01.764888+0000","last_undegraded":"2023-06-23T18:51:01.764888+0000","last_fullsized":"2023-06-23T18:51:01.764888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:01.764540+0000","last_clean_scrub_stamp":"2023-06-23T18:51:01.764540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:32:02.584944+0000","scrub_duration":0.0032137759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"28'2","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:50.000146+0000","last_change":"2023-06-23T18:50:50.000146+0000","last_active":"2023-06-23T18:50:50.000146+0000","last_peered":"2023-06-23T18:50:50.000146+0000","last_clean":"2023-06-23T18:50:50.000146+0000","last_became_active":"2023-06-23T18:49:36.390542+0000","last_became_peered":"2023-06-23T18:49:36.390542+0000","last_unstale":"2023-06-23T18:50:50.000146+0000","last_undegraded":"2023-06-23T18:50:50.000146+0000","last_fullsized":"2023-06-23T18:50:50.000146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2023-06-23T18:50:49.999846+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.999846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:41:40.864462+0000","scrub_duration":0.0065858610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:30.996626+0000","last_change":"2023-06-23T18:51:30.996626+0000","last_active":"2023-06-23T18:51:30.996626+0000","last_peered":"2023-06-23T18:51:30.996626+0000","last_clean":"2023-06-23T18:51:30.996626+0000","last_became_active":"2023-06-23T18:49:40.833699+0000","last_became_peered":"2023-06-23T18:49:40.833699+0000","last_unstale":"2023-06-23T18:51:30.996626+0000","last_undegraded":"2023-06-23T18:51:30.996626+0000","last_fullsized":"2023-06-23T18:51:30.996626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:30.996233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:30.996233+0000","last_clean_scrub_stamp":"2023-06-23T18:51:30.996233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:49:31.188032+0000","scrub_duration":0.003721252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:50.813566+0000","last_change":"2023-06-23T18:51:50.813693+0000","last_active":"2023-06-23T18:51:50.813566+0000","last_peered":"2023-06-23T18:51:50.813566+0000","last_clean":"2023-06-23T18:51:50.813566+0000","last_became_active":"2023-06-23T18:49:40.845802+0000","last_became_peered":"2023-06-23T18:49:40.845802+0000","last_unstale":"2023-06-23T18:51:50.813566+0000","last_undegraded":"2023-06-23T18:51:50.813566+0000","last_fullsized":"2023-06-23T18:51:50.813566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:50.813359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:50.813359+0000","last_clean_scrub_stamp":"2023-06-23T18:51:50.813359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:14:18.969385+0000","scrub_duration":0.004014582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.261620+0000","last_change":"2023-06-23T18:51:04.261620+0000","last_active":"2023-06-23T18:51:04.261620+0000","last_peered":"2023-06-23T18:51:04.261620+0000","last_clean":"2023-06-23T18:51:04.261620+0000","last_became_active":"2023-06-23T18:49:36.405706+0000","last_became_peered":"2023-06-23T18:49:36.405706+0000","last_unstale":"2023-06-23T18:51:04.261620+0000","last_undegraded":"2023-06-23T18:51:04.261620+0000","last_fullsized":"2023-06-23T18:51:04.261620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2023-06-23T18:51:04.261136+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.261136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:47:50.728530+0000","scrub_duration":0.011066975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:26.454407+0000","last_change":"2023-06-23T18:51:26.454407+0000","last_active":"2023-06-23T18:51:26.454407+0000","last_peered":"2023-06-23T18:51:26.454407+0000","last_clean":"2023-06-23T18:51:26.454407+0000","last_became_active":"2023-06-23T18:49:36.794756+0000","last_became_peered":"2023-06-23T18:49:36.794756+0000","last_unstale":"2023-06-23T18:51:26.454407+0000","last_undegraded":"2023-06-23T18:51:26.454407+0000","last_fullsized":"2023-06-23T18:51:26.454407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:26.454074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:26.454074+0000","last_clean_scrub_stamp":"2023-06-23T18:51:26.454074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:40.384197+0000","scrub_duration":0.0034144069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:33.750360+0000","last_change":"2023-06-23T18:51:33.750496+0000","last_active":"2023-06-23T18:51:33.750360+0000","last_peered":"2023-06-23T18:51:33.750360+0000","last_clean":"2023-06-23T18:51:33.750360+0000","last_became_active":"2023-06-23T18:49:40.849846+0000","last_became_peered":"2023-06-23T18:49:40.849846+0000","last_unstale":"2023-06-23T18:51:33.750360+0000","last_undegraded":"2023-06-23T18:51:33.750360+0000","last_fullsized":"2023-06-23T18:51:33.750360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:33.750130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:33.750130+0000","last_clean_scrub_stamp":"2023-06-23T18:51:33.750130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:38:16.159463+0000","scrub_duration":0.004202356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:28.824624+0000","last_change":"2023-06-23T18:51:28.824624+0000","last_active":"2023-06-23T18:51:28.824624+0000","last_peered":"2023-06-23T18:51:28.824624+0000","last_clean":"2023-06-23T18:51:28.824624+0000","last_became_active":"2023-06-23T18:49:36.386802+0000","last_became_peered":"2023-06-23T18:49:36.386802+0000","last_unstale":"2023-06-23T18:51:28.824624+0000","last_undegraded":"2023-06-23T18:51:28.824624+0000","last_fullsized":"2023-06-23T18:51:28.824624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:28.824317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:28.824317+0000","last_clean_scrub_stamp":"2023-06-23T18:51:28.824317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:35:55.915718+0000","scrub_duration":0.0032302260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.409871+0000","last_change":"2023-06-23T18:51:19.409871+0000","last_active":"2023-06-23T18:51:19.409871+0000","last_peered":"2023-06-23T18:51:19.409871+0000","last_clean":"2023-06-23T18:51:19.409871+0000","last_became_active":"2023-06-23T18:49:36.790689+0000","last_became_peered":"2023-06-23T18:49:36.790689+0000","last_unstale":"2023-06-23T18:51:19.409871+0000","last_undegraded":"2023-06-23T18:51:19.409871+0000","last_fullsized":"2023-06-23T18:51:19.409871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.409589+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.409589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:58:04.291439+0000","scrub_duration":0.0031584650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.502356+0000","last_change":"2023-06-23T18:50:47.502356+0000","last_active":"2023-06-23T18:50:47.502356+0000","last_peered":"2023-06-23T18:50:47.502356+0000","last_clean":"2023-06-23T18:50:47.502356+0000","last_became_active":"2023-06-23T18:49:36.390118+0000","last_became_peered":"2023-06-23T18:49:36.390118+0000","last_unstale":"2023-06-23T18:50:47.502356+0000","last_undegraded":"2023-06-23T18:50:47.502356+0000","last_fullsized":"2023-06-23T18:50:47.502356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.502043+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.502043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:55:29.837409+0000","scrub_duration":0.0040377850000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.792192+0000","last_change":"2023-06-23T18:50:53.792192+0000","last_active":"2023-06-23T18:50:53.792192+0000","last_peered":"2023-06-23T18:50:53.792192+0000","last_clean":"2023-06-23T18:50:53.792192+0000","last_became_active":"2023-06-23T18:49:36.769188+0000","last_became_peered":"2023-06-23T18:49:36.769188+0000","last_unstale":"2023-06-23T18:50:53.792192+0000","last_undegraded":"2023-06-23T18:50:53.792192+0000","last_fullsized":"2023-06-23T18:50:53.792192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.791890+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.791890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:31.408545+0000","scrub_duration":0.0032528520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:24.789541+0000","last_change":"2023-06-23T18:51:24.789541+0000","last_active":"2023-06-23T18:51:24.789541+0000","last_peered":"2023-06-23T18:51:24.789541+0000","last_clean":"2023-06-23T18:51:24.789541+0000","last_became_active":"2023-06-23T18:49:40.835242+0000","last_became_peered":"2023-06-23T18:49:40.835242+0000","last_unstale":"2023-06-23T18:51:24.789541+0000","last_undegraded":"2023-06-23T18:51:24.789541+0000","last_fullsized":"2023-06-23T18:51:24.789541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:24.789157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:24.789157+0000","last_clean_scrub_stamp":"2023-06-23T18:51:24.789157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:30:15.829578+0000","scrub_duration":0.0044123920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"28'4","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:31.877843+0000","last_change":"2023-06-23T18:51:31.877843+0000","last_active":"2023-06-23T18:51:31.877843+0000","last_peered":"2023-06-23T18:51:31.877843+0000","last_clean":"2023-06-23T18:51:31.877843+0000","last_became_active":"2023-06-23T18:49:36.396305+0000","last_became_peered":"2023-06-23T18:49:36.396305+0000","last_unstale":"2023-06-23T18:51:31.877843+0000","last_undegraded":"2023-06-23T18:51:31.877843+0000","last_fullsized":"2023-06-23T18:51:31.877843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2023-06-23T18:51:31.877545+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2023-06-23T18:51:31.877545+0000","last_clean_scrub_stamp":"2023-06-23T18:51:31.877545+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:30.936660+0000","scrub_duration":0.012813868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.522875+0000","last_change":"2023-06-23T18:51:15.522875+0000","last_active":"2023-06-23T18:51:15.522875+0000","last_peered":"2023-06-23T18:51:15.522875+0000","last_clean":"2023-06-23T18:51:15.522875+0000","last_became_active":"2023-06-23T18:49:36.810066+0000","last_became_peered":"2023-06-23T18:49:36.810066+0000","last_unstale":"2023-06-23T18:51:15.522875+0000","last_undegraded":"2023-06-23T18:51:15.522875+0000","last_fullsized":"2023-06-23T18:51:15.522875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.522580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.522580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:01.989974+0000","scrub_duration":0.0030724910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:40.986759+0000","last_change":"2023-06-23T18:51:40.986934+0000","last_active":"2023-06-23T18:51:40.986759+0000","last_peered":"2023-06-23T18:51:40.986759+0000","last_clean":"2023-06-23T18:51:40.986759+0000","last_became_active":"2023-06-23T18:49:40.845309+0000","last_became_peered":"2023-06-23T18:49:40.845309+0000","last_unstale":"2023-06-23T18:51:40.986759+0000","last_undegraded":"2023-06-23T18:51:40.986759+0000","last_fullsized":"2023-06-23T18:51:40.986759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:40.986459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:40.986459+0000","last_clean_scrub_stamp":"2023-06-23T18:51:40.986459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:00:35.154381+0000","scrub_duration":0.0039978369999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.142650+0000","last_change":"2023-06-23T18:51:15.142650+0000","last_active":"2023-06-23T18:51:15.142650+0000","last_peered":"2023-06-23T18:51:15.142650+0000","last_clean":"2023-06-23T18:51:15.142650+0000","last_became_active":"2023-06-23T18:49:36.816405+0000","last_became_peered":"2023-06-23T18:49:36.816405+0000","last_unstale":"2023-06-23T18:51:15.142650+0000","last_undegraded":"2023-06-23T18:51:15.142650+0000","last_fullsized":"2023-06-23T18:51:15.142650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.142332+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.142332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:49.196465+0000","scrub_duration":0.0037055650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.540803+0000","last_change":"2023-06-23T18:51:04.540803+0000","last_active":"2023-06-23T18:51:04.540803+0000","last_peered":"2023-06-23T18:51:04.540803+0000","last_clean":"2023-06-23T18:51:04.540803+0000","last_became_active":"2023-06-23T18:49:36.796046+0000","last_became_peered":"2023-06-23T18:49:36.796046+0000","last_unstale":"2023-06-23T18:51:04.540803+0000","last_undegraded":"2023-06-23T18:51:04.540803+0000","last_fullsized":"2023-06-23T18:51:04.540803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.540495+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.540495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:25.678734+0000","scrub_duration":0.0032800960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.895594+0000","last_change":"2023-06-23T18:51:04.895594+0000","last_active":"2023-06-23T18:51:04.895594+0000","last_peered":"2023-06-23T18:51:04.895594+0000","last_clean":"2023-06-23T18:51:04.895594+0000","last_became_active":"2023-06-23T18:49:36.766657+0000","last_became_peered":"2023-06-23T18:49:36.766657+0000","last_unstale":"2023-06-23T18:51:04.895594+0000","last_undegraded":"2023-06-23T18:51:04.895594+0000","last_fullsized":"2023-06-23T18:51:04.895594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.895432+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.895432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.033671+0000","scrub_duration":0.001770878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:18.367573+0000","last_change":"2023-06-23T18:51:18.367573+0000","last_active":"2023-06-23T18:51:18.367573+0000","last_peered":"2023-06-23T18:51:18.367573+0000","last_clean":"2023-06-23T18:51:18.367573+0000","last_became_active":"2023-06-23T18:49:36.789050+0000","last_became_peered":"2023-06-23T18:49:36.789050+0000","last_unstale":"2023-06-23T18:51:18.367573+0000","last_undegraded":"2023-06-23T18:51:18.367573+0000","last_fullsized":"2023-06-23T18:51:18.367573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:18.367192+0000","last_clean_scrub_stamp":"2023-06-23T18:51:18.367192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:49:11.666258+0000","scrub_duration":0.0031402629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:03.673633+0000","last_change":"2023-06-23T18:51:03.673633+0000","last_active":"2023-06-23T18:51:03.673633+0000","last_peered":"2023-06-23T18:51:03.673633+0000","last_clean":"2023-06-23T18:51:03.673633+0000","last_became_active":"2023-06-23T18:49:36.787270+0000","last_became_peered":"2023-06-23T18:49:36.787270+0000","last_unstale":"2023-06-23T18:51:03.673633+0000","last_undegraded":"2023-06-23T18:51:03.673633+0000","last_fullsized":"2023-06-23T18:51:03.673633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:03.673345+0000","last_clean_scrub_stamp":"2023-06-23T18:51:03.673345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:05:45.269103+0000","scrub_duration":0.0037635910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:36.975675+0000","last_change":"2023-06-23T18:51:36.975675+0000","last_active":"2023-06-23T18:51:36.975675+0000","last_peered":"2023-06-23T18:51:36.975675+0000","last_clean":"2023-06-23T18:51:36.975675+0000","last_became_active":"2023-06-23T18:49:36.763724+0000","last_became_peered":"2023-06-23T18:49:36.763724+0000","last_unstale":"2023-06-23T18:51:36.975675+0000","last_undegraded":"2023-06-23T18:51:36.975675+0000","last_fullsized":"2023-06-23T18:51:36.975675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:36.975332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:36.975332+0000","last_clean_scrub_stamp":"2023-06-23T18:51:36.975332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:31:37.404465+0000","scrub_duration":0.0033843889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:04.901895+0000","last_change":"2023-06-23T18:51:04.901895+0000","last_active":"2023-06-23T18:51:04.901895+0000","last_peered":"2023-06-23T18:51:04.901895+0000","last_clean":"2023-06-23T18:51:04.901895+0000","last_became_active":"2023-06-23T18:49:36.812622+0000","last_became_peered":"2023-06-23T18:49:36.812622+0000","last_unstale":"2023-06-23T18:51:04.901895+0000","last_undegraded":"2023-06-23T18:51:04.901895+0000","last_fullsized":"2023-06-23T18:51:04.901895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:04.901580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:04.901580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:26.039820+0000","scrub_duration":0.0032852200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.172651+0000","last_change":"2023-06-23T18:50:53.172651+0000","last_active":"2023-06-23T18:50:53.172651+0000","last_peered":"2023-06-23T18:50:53.172651+0000","last_clean":"2023-06-23T18:50:53.172651+0000","last_became_active":"2023-06-23T18:49:36.796716+0000","last_became_peered":"2023-06-23T18:49:36.796716+0000","last_unstale":"2023-06-23T18:50:53.172651+0000","last_undegraded":"2023-06-23T18:50:53.172651+0000","last_fullsized":"2023-06-23T18:50:53.172651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.172373+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.172373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:54:06.374063+0000","scrub_duration":0.0034361800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.118846+0000","last_change":"2023-06-23T18:51:19.118846+0000","last_active":"2023-06-23T18:51:19.118846+0000","last_peered":"2023-06-23T18:51:19.118846+0000","last_clean":"2023-06-23T18:51:19.118846+0000","last_became_active":"2023-06-23T18:49:36.801758+0000","last_became_peered":"2023-06-23T18:49:36.801758+0000","last_unstale":"2023-06-23T18:51:19.118846+0000","last_undegraded":"2023-06-23T18:51:19.118846+0000","last_fullsized":"2023-06-23T18:51:19.118846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.118478+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.118478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:07:21.530071+0000","scrub_duration":0.0037465380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:57.128267+0000","last_change":"2023-06-23T18:50:57.128267+0000","last_active":"2023-06-23T18:50:57.128267+0000","last_peered":"2023-06-23T18:50:57.128267+0000","last_clean":"2023-06-23T18:50:57.128267+0000","last_became_active":"2023-06-23T18:49:36.808631+0000","last_became_peered":"2023-06-23T18:49:36.808631+0000","last_unstale":"2023-06-23T18:50:57.128267+0000","last_undegraded":"2023-06-23T18:50:57.128267+0000","last_fullsized":"2023-06-23T18:50:57.128267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:57.127936+0000","last_clean_scrub_stamp":"2023-06-23T18:50:57.127936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:49:31.182068+0000","scrub_duration":0.0033896339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.010312+0000","last_change":"2023-06-23T18:50:53.010312+0000","last_active":"2023-06-23T18:50:53.010312+0000","last_peered":"2023-06-23T18:50:53.010312+0000","last_clean":"2023-06-23T18:50:53.010312+0000","last_became_active":"2023-06-23T18:49:36.811557+0000","last_became_peered":"2023-06-23T18:49:36.811557+0000","last_unstale":"2023-06-23T18:50:53.010312+0000","last_undegraded":"2023-06-23T18:50:53.010312+0000","last_fullsized":"2023-06-23T18:50:53.010312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.010001+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.010001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:40.121565+0000","scrub_duration":0.0034279800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:22.998993+0000","last_change":"2023-06-23T18:51:22.998993+0000","last_active":"2023-06-23T18:51:22.998993+0000","last_peered":"2023-06-23T18:51:22.998993+0000","last_clean":"2023-06-23T18:51:22.998993+0000","last_became_active":"2023-06-23T18:49:36.801805+0000","last_became_peered":"2023-06-23T18:49:36.801805+0000","last_unstale":"2023-06-23T18:51:22.998993+0000","last_undegraded":"2023-06-23T18:51:22.998993+0000","last_fullsized":"2023-06-23T18:51:22.998993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:22.998587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:22.998587+0000","last_clean_scrub_stamp":"2023-06-23T18:51:22.998587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:15:04.619361+0000","scrub_duration":0.0036465489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.135927+0000","last_change":"2023-06-23T18:51:16.135927+0000","last_active":"2023-06-23T18:51:16.135927+0000","last_peered":"2023-06-23T18:51:16.135927+0000","last_clean":"2023-06-23T18:51:16.135927+0000","last_became_active":"2023-06-23T18:49:36.816499+0000","last_became_peered":"2023-06-23T18:49:36.816499+0000","last_unstale":"2023-06-23T18:51:16.135927+0000","last_undegraded":"2023-06-23T18:51:16.135927+0000","last_fullsized":"2023-06-23T18:51:16.135927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.135626+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.135626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:55:33.268963+0000","scrub_duration":0.0035515730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:21.392764+0000","last_change":"2023-06-23T18:51:21.392764+0000","last_active":"2023-06-23T18:51:21.392764+0000","last_peered":"2023-06-23T18:51:21.392764+0000","last_clean":"2023-06-23T18:51:21.392764+0000","last_became_active":"2023-06-23T18:49:36.764506+0000","last_became_peered":"2023-06-23T18:49:36.764506+0000","last_unstale":"2023-06-23T18:51:21.392764+0000","last_undegraded":"2023-06-23T18:51:21.392764+0000","last_fullsized":"2023-06-23T18:51:21.392764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:21.392373+0000","last_clean_scrub_stamp":"2023-06-23T18:51:21.392373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:51:06.440447+0000","scrub_duration":0.00346124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:06.932333+0000","last_change":"2023-06-23T18:51:06.932333+0000","last_active":"2023-06-23T18:51:06.932333+0000","last_peered":"2023-06-23T18:51:06.932333+0000","last_clean":"2023-06-23T18:51:06.932333+0000","last_became_active":"2023-06-23T18:49:36.794533+0000","last_became_peered":"2023-06-23T18:49:36.794533+0000","last_unstale":"2023-06-23T18:51:06.932333+0000","last_undegraded":"2023-06-23T18:51:06.932333+0000","last_fullsized":"2023-06-23T18:51:06.932333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:06.932039+0000","last_clean_scrub_stamp":"2023-06-23T18:51:06.932039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:52:10.485465+0000","scrub_duration":0.0035631550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:55.038156+0000","last_change":"2023-06-23T18:50:55.038156+0000","last_active":"2023-06-23T18:50:55.038156+0000","last_peered":"2023-06-23T18:50:55.038156+0000","last_clean":"2023-06-23T18:50:55.038156+0000","last_became_active":"2023-06-23T18:49:36.787403+0000","last_became_peered":"2023-06-23T18:49:36.787403+0000","last_unstale":"2023-06-23T18:50:55.038156+0000","last_undegraded":"2023-06-23T18:50:55.038156+0000","last_fullsized":"2023-06-23T18:50:55.038156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:55.037786+0000","last_clean_scrub_stamp":"2023-06-23T18:50:55.037786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.318885+0000","scrub_duration":0.0033358239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:47.840761+0000","last_change":"2023-06-23T18:50:47.840761+0000","last_active":"2023-06-23T18:50:47.840761+0000","last_peered":"2023-06-23T18:50:47.840761+0000","last_clean":"2023-06-23T18:50:47.840761+0000","last_became_active":"2023-06-23T18:49:36.794464+0000","last_became_peered":"2023-06-23T18:49:36.794464+0000","last_unstale":"2023-06-23T18:50:47.840761+0000","last_undegraded":"2023-06-23T18:50:47.840761+0000","last_fullsized":"2023-06-23T18:50:47.840761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:47.840462+0000","last_clean_scrub_stamp":"2023-06-23T18:50:47.840462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:48.032261+0000","scrub_duration":0.0036463200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:54.964106+0000","last_change":"2023-06-23T18:50:54.964106+0000","last_active":"2023-06-23T18:50:54.964106+0000","last_peered":"2023-06-23T18:50:54.964106+0000","last_clean":"2023-06-23T18:50:54.964106+0000","last_became_active":"2023-06-23T18:49:36.815071+0000","last_became_peered":"2023-06-23T18:49:36.815071+0000","last_unstale":"2023-06-23T18:50:54.964106+0000","last_undegraded":"2023-06-23T18:50:54.964106+0000","last_fullsized":"2023-06-23T18:50:54.964106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:54.963811+0000","last_clean_scrub_stamp":"2023-06-23T18:50:54.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:43:07.244910+0000","scrub_duration":0.0037456719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:08.183847+0000","last_change":"2023-06-23T18:51:08.183847+0000","last_active":"2023-06-23T18:51:08.183847+0000","last_peered":"2023-06-23T18:51:08.183847+0000","last_clean":"2023-06-23T18:51:08.183847+0000","last_became_active":"2023-06-23T18:49:36.801315+0000","last_became_peered":"2023-06-23T18:49:36.801315+0000","last_unstale":"2023-06-23T18:51:08.183847+0000","last_undegraded":"2023-06-23T18:51:08.183847+0000","last_fullsized":"2023-06-23T18:51:08.183847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:08.183558+0000","last_clean_scrub_stamp":"2023-06-23T18:51:08.183558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:37.383643+0000","scrub_duration":0.003312274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:19.585577+0000","last_change":"2023-06-23T18:51:19.585577+0000","last_active":"2023-06-23T18:51:19.585577+0000","last_peered":"2023-06-23T18:51:19.585577+0000","last_clean":"2023-06-23T18:51:19.585577+0000","last_became_active":"2023-06-23T18:49:36.807428+0000","last_became_peered":"2023-06-23T18:49:36.807428+0000","last_unstale":"2023-06-23T18:51:19.585577+0000","last_undegraded":"2023-06-23T18:51:19.585577+0000","last_fullsized":"2023-06-23T18:51:19.585577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:19.585278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:19.585278+0000","last_clean_scrub_stamp":"2023-06-23T18:51:19.585278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:08:48.785363+0000","scrub_duration":0.0035514539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:49.569592+0000","last_change":"2023-06-23T18:50:49.569592+0000","last_active":"2023-06-23T18:50:49.569592+0000","last_peered":"2023-06-23T18:50:49.569592+0000","last_clean":"2023-06-23T18:50:49.569592+0000","last_became_active":"2023-06-23T18:49:36.772648+0000","last_became_peered":"2023-06-23T18:49:36.772648+0000","last_unstale":"2023-06-23T18:50:49.569592+0000","last_undegraded":"2023-06-23T18:50:49.569592+0000","last_fullsized":"2023-06-23T18:50:49.569592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:49.569200+0000","last_clean_scrub_stamp":"2023-06-23T18:50:49.569200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:29:53.991735+0000","scrub_duration":0.0038698320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:53.353850+0000","last_change":"2023-06-23T18:50:53.353850+0000","last_active":"2023-06-23T18:50:53.353850+0000","last_peered":"2023-06-23T18:50:53.353850+0000","last_clean":"2023-06-23T18:50:53.353850+0000","last_became_active":"2023-06-23T18:49:36.768150+0000","last_became_peered":"2023-06-23T18:49:36.768150+0000","last_unstale":"2023-06-23T18:50:53.353850+0000","last_undegraded":"2023-06-23T18:50:53.353850+0000","last_fullsized":"2023-06-23T18:50:53.353850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:53.353661+0000","last_clean_scrub_stamp":"2023-06-23T18:50:53.353661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:43:14.491900+0000","scrub_duration":0.0026633910000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:24.990634+0000","last_change":"2023-06-23T18:51:24.990634+0000","last_active":"2023-06-23T18:51:24.990634+0000","last_peered":"2023-06-23T18:51:24.990634+0000","last_clean":"2023-06-23T18:51:24.990634+0000","last_became_active":"2023-06-23T18:49:36.771897+0000","last_became_peered":"2023-06-23T18:49:36.771897+0000","last_unstale":"2023-06-23T18:51:24.990634+0000","last_undegraded":"2023-06-23T18:51:24.990634+0000","last_fullsized":"2023-06-23T18:51:24.990634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:24.990262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:24.990262+0000","last_clean_scrub_stamp":"2023-06-23T18:51:24.990262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:09:00.009550+0000","scrub_duration":0.0037393579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.249389+0000","last_change":"2023-06-23T18:50:44.249389+0000","last_active":"2023-06-23T18:50:44.249389+0000","last_peered":"2023-06-23T18:50:44.249389+0000","last_clean":"2023-06-23T18:50:44.249389+0000","last_became_active":"2023-06-23T18:49:36.797565+0000","last_became_peered":"2023-06-23T18:49:36.797565+0000","last_unstale":"2023-06-23T18:50:44.249389+0000","last_undegraded":"2023-06-23T18:50:44.249389+0000","last_fullsized":"2023-06-23T18:50:44.249389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.249097+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.249097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:07:55.436409+0000","scrub_duration":0.0034108699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:20.105029+0000","last_change":"2023-06-23T18:51:20.105118+0000","last_active":"2023-06-23T18:51:20.105029+0000","last_peered":"2023-06-23T18:51:20.105029+0000","last_clean":"2023-06-23T18:51:20.105029+0000","last_became_active":"2023-06-23T18:49:36.767320+0000","last_became_peered":"2023-06-23T18:49:36.767320+0000","last_unstale":"2023-06-23T18:51:20.105029+0000","last_undegraded":"2023-06-23T18:51:20.105029+0000","last_fullsized":"2023-06-23T18:51:20.105029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:20.104830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:20.104830+0000","last_clean_scrub_stamp":"2023-06-23T18:51:20.104830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:18:58.801775+0000","scrub_duration":0.0032870960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:42.904789+0000","last_change":"2023-06-23T18:50:42.904856+0000","last_active":"2023-06-23T18:50:42.904789+0000","last_peered":"2023-06-23T18:50:42.904789+0000","last_clean":"2023-06-23T18:50:42.904789+0000","last_became_active":"2023-06-23T18:49:36.760035+0000","last_became_peered":"2023-06-23T18:49:36.760035+0000","last_unstale":"2023-06-23T18:50:42.904789+0000","last_undegraded":"2023-06-23T18:50:42.904789+0000","last_fullsized":"2023-06-23T18:50:42.904789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:42.904670+0000","last_clean_scrub_stamp":"2023-06-23T18:50:42.904670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:01:59.196272+0000","scrub_duration":0.001431545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:50:44.850052+0000","last_change":"2023-06-23T18:50:44.850145+0000","last_active":"2023-06-23T18:50:44.850052+0000","last_peered":"2023-06-23T18:50:44.850052+0000","last_clean":"2023-06-23T18:50:44.850052+0000","last_became_active":"2023-06-23T18:49:36.760476+0000","last_became_peered":"2023-06-23T18:49:36.760476+0000","last_unstale":"2023-06-23T18:50:44.850052+0000","last_undegraded":"2023-06-23T18:50:44.850052+0000","last_fullsized":"2023-06-23T18:50:44.850052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:50:44.849822+0000","last_clean_scrub_stamp":"2023-06-23T18:50:44.849822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:57:45.611206+0000","scrub_duration":0.0040367679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:16.818626+0000","last_change":"2023-06-23T18:51:16.818729+0000","last_active":"2023-06-23T18:51:16.818626+0000","last_peered":"2023-06-23T18:51:16.818626+0000","last_clean":"2023-06-23T18:51:16.818626+0000","last_became_active":"2023-06-23T18:49:36.808811+0000","last_became_peered":"2023-06-23T18:49:36.808811+0000","last_unstale":"2023-06-23T18:51:16.818626+0000","last_undegraded":"2023-06-23T18:51:16.818626+0000","last_fullsized":"2023-06-23T18:51:16.818626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:16.818400+0000","last_clean_scrub_stamp":"2023-06-23T18:51:16.818400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:51:54.435055+0000","scrub_duration":0.0031917149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:15.841885+0000","last_change":"2023-06-23T18:51:15.841885+0000","last_active":"2023-06-23T18:51:15.841885+0000","last_peered":"2023-06-23T18:51:15.841885+0000","last_clean":"2023-06-23T18:51:15.841885+0000","last_became_active":"2023-06-23T18:49:36.794733+0000","last_became_peered":"2023-06-23T18:49:36.794733+0000","last_unstale":"2023-06-23T18:51:15.841885+0000","last_undegraded":"2023-06-23T18:51:15.841885+0000","last_fullsized":"2023-06-23T18:51:15.841885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:15.841580+0000","last_clean_scrub_stamp":"2023-06-23T18:51:15.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:48:02.308974+0000","scrub_duration":0.0037383379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:17.889932+0000","last_change":"2023-06-23T18:51:17.889932+0000","last_active":"2023-06-23T18:51:17.889932+0000","last_peered":"2023-06-23T18:51:17.889932+0000","last_clean":"2023-06-23T18:51:17.889932+0000","last_became_active":"2023-06-23T18:49:36.787225+0000","last_became_peered":"2023-06-23T18:49:36.787225+0000","last_unstale":"2023-06-23T18:51:17.889932+0000","last_undegraded":"2023-06-23T18:51:17.889932+0000","last_fullsized":"2023-06-23T18:51:17.889932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:17.889533+0000","last_clean_scrub_stamp":"2023-06-23T18:51:17.889533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:55:13.585477+0000","scrub_duration":0.0036828059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:14.864247+0000","last_change":"2023-06-23T18:51:14.864247+0000","last_active":"2023-06-23T18:51:14.864247+0000","last_peered":"2023-06-23T18:51:14.864247+0000","last_clean":"2023-06-23T18:51:14.864247+0000","last_became_active":"2023-06-23T18:49:36.816031+0000","last_became_peered":"2023-06-23T18:49:36.816031+0000","last_unstale":"2023-06-23T18:51:14.864247+0000","last_undegraded":"2023-06-23T18:51:14.864247+0000","last_fullsized":"2023-06-23T18:51:14.864247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:14.863822+0000","last_clean_scrub_stamp":"2023-06-23T18:51:14.863822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:39:19.677369+0000","scrub_duration":0.0039650900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-23T18:51:10.522861+0000","last_change":"2023-06-23T18:51:10.522861+0000","last_active":"2023-06-23T18:51:10.522861+0000","last_peered":"2023-06-23T18:51:10.522861+0000","last_clean":"2023-06-23T18:51:10.522861+0000","last_became_active":"2023-06-23T18:49:36.796505+0000","last_became_peered":"2023-06-23T18:49:36.796505+0000","last_unstale":"2023-06-23T18:51:10.522861+0000","last_undegraded":"2023-06-23T18:51:10.522861+0000","last_fullsized":"2023-06-23T18:51:10.522861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:51:10.522471+0000","last_clean_scrub_stamp":"2023-06-23T18:51:10.522471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:29:37.879654+0000","scrub_duration":0.0033039380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6334,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":12668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67446,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.129,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.871,"15min":0.879},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.248,"15min":1.248},"last":1.214}]},{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.871,"15min":0.872},"min":{"1min":0.72099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0669999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1950000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.03}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.68700000000000006,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1950000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2410000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.98199999999999998}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92300000000000004,"15min":0.92200000000000004},"min":{"1min":0.77400000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.2829999999999999,"5min":1.327,"15min":1.327},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98999999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.113}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93700000000000006,"15min":0.93899999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0620000000000001,"15min":1.0820000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2030000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.1799999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.105,"15min":1.117},"min":{"1min":0.79600000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.345,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.139},{"interface":"front","average":{"1min":1.054,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.008}]}]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.022},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.147},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.91800000000000004,"15min":0.91000000000000003},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98099999999999998,"15min":0.98999999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.218,"5min":1.589,"15min":1.589},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98599999999999999,"15min":0.98499999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.266,"5min":1.496,"15min":1.496},"last":1.0740000000000001}]},{"osd":3,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.67200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1299999999999999,"5min":1.143,"15min":1.143},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1619999999999999,"5min":1.569,"15min":1.569},"last":1.103}]},{"osd":5,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0660000000000001,"15min":1.0800000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3740000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0649999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.246,"5min":1.472,"15min":1.472},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.129,"15min":1.143},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.262,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.2090000000000001,"15min":1.22},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.454,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Jun 23 18:51:27 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.119,"15min":1.131},"min":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.615,"15min":1.615},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.4299999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.05}]}]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":319488,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.97899999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.04,"5min":1.054,"15min":1.054},"last":0.86499999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1379999999999999,"5min":1.26,"15min":1.26},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.081,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.056,"5min":1.337,"15min":1.337},"last":0.75600000000000001}]},{"osd":4,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89600000000000002,"15min":0.89400000000000002},"min":{"1min":0.57299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1479999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.006,"15min":1.002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.282,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0089999999999999,"15min":1.012},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.274,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0740000000000001}]},{"osd":6,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.58399999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3,"5min":1.802,"15min":1.802},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.052,"15min":1.0509999999999999},"min":{"1min":0.70699999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3120000000000001,"5min":1.879,"15min":1.879},"last":1.139},{"interface":"front","average":{"1min":1.022,"5min":1.026,"15min":1.0269999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3180000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.85399999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":311296,"data_stored":126668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.90400000000000003,"5min":1.54,"15min":1.54},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.99399999999999999,"5min":1.097,"15min":1.097},"last":1.099}]},{"osd":3,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0009999999999999,"5min":1.044,"15min":1.044},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0469999999999999,"5min":1.052,"15min":1.052},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.044},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.98799999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.70899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.234,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.016},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.995,"15min":1.0069999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1870000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":0.97999999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.88},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":1.0660000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.071}]},{"osd":7,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.087,"15min":1.097},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.7969999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3240000000000001,"5min":1.583,"15min":1.583},"last":1.115}]}]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":712174,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94199999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.125,"5min":1.373,"15min":1.373},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.376,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78900000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71399999999999997,"15min":0.70399999999999996},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0640000000000001,"5min":1.097,"15min":1.097},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.45200000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.0509999999999999,"5min":1.214,"15min":1.214},"last":0.66900000000000004}]},{"osd":4,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96799999999999997,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2609999999999999,"5min":1.544,"15min":1.544},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.98299999999999998,"15min":0.97699999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.157}]},{"osd":5,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":0.97399999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2290000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.626,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3360000000000001,"5min":1.627,"15min":1.627},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3069999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.78900000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.175,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.115}]},{"osd":7,"last update":"Fri Jun 23 18:51:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0740000000000001,"15min":1.091},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.212,"5min":1.986,"15min":1.986},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.266,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.2030000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.27300000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84999999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.315,"15min":0.315},"max":{"1min":1.01,"5min":1.226,"15min":1.226},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0209999999999999,"5min":1.288,"15min":1.288},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.29399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.71099999999999997,"15min":0.69199999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.002,"15min":1.002},"min":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.232,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.879,"15min":0.877},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.024,"15min":1.03},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3100000000000001,"5min":1.444,"15min":1.444},"last":1.071}]},{"osd":6,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58099999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.071,"5min":1.468,"15min":1.468},"last":0.877},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.94299999999999995,"15min":0.93799999999999994},"min":{"1min":0.69399999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1779999999999999,"5min":1.593,"15min":1.593},"last":1.044}]},{"osd":7,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.032,"15min":1.032},"min":{"1min":0.73599999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.492,"15min":1.492},"last":1.198},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.018,"15min":1.0369999999999999},"min":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.123,"5min":1.732,"15min":1.732},"last":0.99299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.224,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.014},"min":{"1min":0.82299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.242,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.48999999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.995,"5min":1.331,"15min":1.331},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89100000000000001,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.173,"5min":1.196,"15min":1.196},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.875,"15min":0.86699999999999999},"min":{"1min":0.66700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1930000000000001,"5min":1.204,"15min":1.204},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1599999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.87}]},{"osd":3,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83199999999999996,"15min":0.82399999999999995},"min":{"1min":0.67900000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.155,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.044},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.80400000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.137}]},{"osd":4,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.93700000000000006,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.224,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Jun 23 18:51:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.032,"15min":1.0229999999999999},"min":{"1min":0.78900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.111},{"interface":"front","average":{"1min":0.995,"5min":1.0620000000000001,"15min":1.073},"min":{"1min":0.63600000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Jun 23 18:51:30 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1599999999999999,"15min":1.171},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.91300000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4370000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.2789999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":712082,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.143},{"interface":"front","average":{"1min":0.879,"5min":0.89400000000000002,"15min":0.89600000000000002},"min":{"1min":0.70199999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.198,"15min":1.198},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.624,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.075,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.71499999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.079,"5min":1.504,"15min":1.504},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1279999999999999,"5min":1.27,"15min":1.27},"last":1.048}]},{"osd":3,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.94199999999999995,"15min":0.95199999999999996},"min":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1519999999999999,"5min":1.274,"15min":1.274},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96799999999999997,"15min":0.96999999999999997},"min":{"1min":0.78900000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.127,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.099}]},{"osd":4,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.88600000000000001,"15min":0.88800000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1339999999999999,"5min":1.159,"15min":1.159},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.95099999999999996,"15min":0.95499999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.23,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.224}]},{"osd":6,"last update":"Fri Jun 23 18:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.2390000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.032,"15min":1.03},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.27,"5min":1.407,"15min":1.407},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Jun 23 18:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98499999999999999},"min":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.1539999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.1060000000000001,"15min":1.1200000000000001},"min":{"1min":0.85699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.1919999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.3520000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33723,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:52:06.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-06-23T18:52:06.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 Processor -- start 2023-06-23T18:52:06.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 -- start start 2023-06-23T18:52:06.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40be890 0x7f58b40c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58b40a3850 0x7f58b40bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b40c23a0 con 0x7f58b40bf1a0 2023-06-23T18:52:06.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40aa080 con 0x7f58b40a3850 2023-06-23T18:52:06.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b97f6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40bb060 con 0x7f58b40be890 2023-06-23T18:52:06.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58b40a3850 0x7f58b40bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58b40a3850 0x7f58b40bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34716/0 (socket says 172.21.15.38:34716) 2023-06-23T18:52:06.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 -- 172.21.15.38:0/3367052848 learned_addr learned my addr 172.21.15.38:0/3367052848 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:06.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b2ffd640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40be890 0x7f58b40c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 -- 172.21.15.38:0/3367052848 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40be890 msgr2=0x7f58b40c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:06.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40be890 0x7f58b40c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 -- 172.21.15.38:0/3367052848 >> v1:172.21.15.81:6789/0 conn(0x7f58b40bf1a0 legacy=0x7f58b406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:06.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.270+0000 7f58b27fc640 1 -- 172.21.15.38:0/3367052848 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40c3b60 con 0x7f58b40a3850 2023-06-23T18:52:06.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b27fc640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40a3850 0x7f58b40bec60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098a0 tx=0x7f58a401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ec1dcab3803951 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b1ffb640 1 -- 172.21.15.38:0/3367052848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40ac600 con 0x7f58b40a3850 2023-06-23T18:52:06.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b1ffb640 1 -- 172.21.15.38:0/3367052848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40a8050 con 0x7f58b40a3850 2023-06-23T18:52:06.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b1ffb640 1 -- 172.21.15.38:0/3367052848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40ac980 con 0x7f58b40a3850 2023-06-23T18:52:06.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- 172.21.15.38:0/3367052848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40a3850 msgr2=0x7f58b40bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40a3850 0x7f58b40bec60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098a0 tx=0x7f58a401c3c0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- 172.21.15.38:0/3367052848 shutdown_connections 2023-06-23T18:52:06.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40a3850 0x7f58b40bec60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3367052848 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40be890 0x7f58b40c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- 172.21.15.38:0/3367052848 >> 172.21.15.38:0/3367052848 conn(0x7f58b40a5d50 msgr2=0x7f58b40a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- 172.21.15.38:0/3367052848 shutdown_connections 2023-06-23T18:52:06.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- 172.21.15.38:0/3367052848 wait complete. 2023-06-23T18:52:06.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 Processor -- start 2023-06-23T18:52:06.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- start start 2023-06-23T18:52:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40a3850 0x7f58b4151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 0x7f58b414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40be560 con 0x7f58b40be890 2023-06-23T18:52:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b40bb310 con 0x7f58b40a3850 2023-06-23T18:52:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b97f6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b4152690 con 0x7f58b40bdd40 2023-06-23T18:52:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34726/0 (socket says 172.21.15.38:34726) 2023-06-23T18:52:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.274+0000 7f58b27fc640 1 -- 172.21.15.38:0/3756132939 learned_addr learned my addr 172.21.15.38:0/3756132939 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b2ffd640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40a3850 0x7f58b4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b37fe640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 0x7f58b414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 -- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 msgr2=0x7f58b414c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 0x7f58b414c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 -- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40a3850 msgr2=0x7f58b4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40a3850 0x7f58b4151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 -- 172.21.15.38:0/3756132939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40094d0 con 0x7f58b40be890 2023-06-23T18:52:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b37fe640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 0x7f58b414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:52:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b27fc640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58a401cc60 tx=0x7f58a4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b5610 con 0x7f58b40be890 2023-06-23T18:52:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40b5770 con 0x7f58b40be890 2023-06-23T18:52:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b5b00 con 0x7f58b40be890 2023-06-23T18:52:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b40be280 con 0x7f58b40be890 2023-06-23T18:52:06.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b40bd110 con 0x7f58b40be890 2023-06-23T18:52:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b414db40 con 0x7f58b40be890 2023-06-23T18:52:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58a40b3040 con 0x7f58b40be890 2023-06-23T18:52:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 0x7f58a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f58a411e200 con 0x7f58b40be890 2023-06-23T18:52:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b2ffd640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 0x7f58a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.278+0000 7f58b2ffd640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 0x7f58a0068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58a800b9d0 tx=0x7f58a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.282+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58a40eb410 con 0x7f58b40be890 2023-06-23T18:52:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.438+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f58b414d960 con 0x7f58b40be890 2023-06-23T18:52:06.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.450+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f58a40ace70 con 0x7f58b40be890 2023-06-23T18:52:06.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.450+0000 7f589b7fe640 1 -- 172.21.15.38:0/3756132939 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f58b414d960 con 0x7f58b40be890 2023-06-23T18:52:06.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 msgr2=0x7f58a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 0x7f58a0068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f58a800b9d0 tx=0x7f58a8008040 comp rx=0 tx=0).stop 2023-06-23T18:52:06.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 msgr2=0x7f58b41518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f58a401cc60 tx=0x7f58a4019160 comp rx=0 tx=0).stop 2023-06-23T18:52:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 shutdown_connections 2023-06-23T18:52:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f58a00662b0 0x7f58a0068760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b40bdd40 0x7f58b414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58b40be890 0x7f58b41518a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 --2- 172.21.15.38:0/3756132939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40a3850 0x7f58b4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 >> 172.21.15.38:0/3756132939 conn(0x7f58b40a5d50 msgr2=0x7f58b40a5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 shutdown_connections 2023-06-23T18:52:06.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.454+0000 7f58b97f6640 1 -- 172.21.15.38:0/3756132939 wait complete. 2023-06-23T18:52:06.477 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-23T18:52:06.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:52:06.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 Processor -- start 2023-06-23T18:52:06.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 -- start start 2023-06-23T18:52:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9480bea40 0x7fd9480a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9480a30c0 0x7fd9480c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd948152830 con 0x7fd9480bee10 2023-06-23T18:52:06.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9480c22a0 con 0x7fd9480bea40 2023-06-23T18:52:06.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94cd5e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9480c2870 con 0x7fd9480a30c0 2023-06-23T18:52:06.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd946d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd9480bee10 0x7fd94806a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52902/0 (socket says 172.21.15.38:52902) 2023-06-23T18:52:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd946d9d640 1 -- 172.21.15.38:0/260552164 learned_addr learned my addr 172.21.15.38:0/260552164 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94659c640 1 --2- 172.21.15.38:0/260552164 >> v2:172.21.15.38:3300/0 conn(0x7fd9480bea40 0x7fd9480a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd945d9b640 1 --2- 172.21.15.38:0/260552164 >> v2:172.21.15.81:3300/0 conn(0x7fd9480a30c0 0x7fd9480c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94659c640 1 -- 172.21.15.38:0/260552164 >> v2:172.21.15.81:3300/0 conn(0x7fd9480a30c0 msgr2=0x7fd9480c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94659c640 1 --2- 172.21.15.38:0/260552164 >> v2:172.21.15.81:3300/0 conn(0x7fd9480a30c0 0x7fd9480c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94659c640 1 -- 172.21.15.38:0/260552164 >> v1:172.21.15.38:6789/0 conn(0x7fd9480bee10 legacy=0x7fd94806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94559a640 1 -- 172.21.15.38:0/260552164 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372284616 0 0) 0x7fd948152830 con 0x7fd9480bee10 2023-06-23T18:52:06.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.602+0000 7fd94659c640 1 -- 172.21.15.38:0/260552164 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480b7950 con 0x7fd9480bea40 2023-06-23T18:52:06.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94659c640 1 --2- 172.21.15.38:0/260552164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bea40 0x7fd9480a35f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd9480c1cf0 tx=0x7fd93801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7293ee9bd1de8ade server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94559a640 1 -- 172.21.15.38:0/260552164 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380a6670 con 0x7fd9480bea40 2023-06-23T18:52:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94559a640 1 -- 172.21.15.38:0/260552164 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd9380a67d0 con 0x7fd9480bea40 2023-06-23T18:52:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94559a640 1 -- 172.21.15.38:0/260552164 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380a6b80 con 0x7fd9480bea40 2023-06-23T18:52:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- 172.21.15.38:0/260552164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bea40 msgr2=0x7fd9480a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/260552164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bea40 0x7fd9480a35f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd9480c1cf0 tx=0x7fd93801c880 comp rx=0 tx=0).stop 2023-06-23T18:52:06.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- 172.21.15.38:0/260552164 shutdown_connections 2023-06-23T18:52:06.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/260552164 >> v2:172.21.15.81:3300/0 conn(0x7fd9480a30c0 0x7fd9480c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/260552164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bea40 0x7fd9480a35f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- 172.21.15.38:0/260552164 >> 172.21.15.38:0/260552164 conn(0x7fd9480a5cc0 msgr2=0x7fd9480a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- 172.21.15.38:0/260552164 shutdown_connections 2023-06-23T18:52:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- 172.21.15.38:0/260552164 wait complete. 2023-06-23T18:52:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 Processor -- start 2023-06-23T18:52:06.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 -- start start 2023-06-23T18:52:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9480a30c0 0x7fd948148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9480bea40 0x7fd948142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.606+0000 7fd94cd5e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481e9c60 con 0x7fd9480bee10 2023-06-23T18:52:06.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480b8940 con 0x7fd9480bea40 2023-06-23T18:52:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480b8660 con 0x7fd9480a30c0 2023-06-23T18:52:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34744/0 (socket says 172.21.15.38:34744) 2023-06-23T18:52:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 -- 172.21.15.38:0/631792280 learned_addr learned my addr 172.21.15.38:0/631792280 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:06.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94659c640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9480a30c0 0x7fd948148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd945d9b640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9480bea40 0x7fd948142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 -- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9480a30c0 msgr2=0x7fd948148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9480a30c0 0x7fd948148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 -- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9480bea40 msgr2=0x7fd948142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9480bea40 0x7fd948142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 -- 172.21.15.38:0/631792280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938009a70 con 0x7fd9480bee10 2023-06-23T18:52:06.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd946d9d640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c3c0 tx=0x7fd94000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400074e0 con 0x7fd9480bee10 2023-06-23T18:52:06.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd940007640 con 0x7fd9480bee10 2023-06-23T18:52:06.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480b72c0 con 0x7fd9480bee10 2023-06-23T18:52:06.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940004a50 con 0x7fd9480bee10 2023-06-23T18:52:06.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948149540 con 0x7fd9480bee10 2023-06-23T18:52:06.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9481e9da0 con 0x7fd9480bee10 2023-06-23T18:52:06.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd940004bb0 con 0x7fd9480bee10 2023-06-23T18:52:06.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 0x7fd928068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd940083dd0 con 0x7fd9480bee10 2023-06-23T18:52:06.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94659c640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 0x7fd928068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.610+0000 7fd94659c640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 0x7fd928068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9380af000 tx=0x7fd9380b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.614+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9481e9da0 con 0x7fd9480bee10 2023-06-23T18:52:06.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.802+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9481e9da0 con 0x7fd9480bee10 2023-06-23T18:52:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd936ffd640 1 -- 172.21.15.38:0/631792280 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7fd9481e9da0 con 0x7fd9480bee10 2023-06-23T18:52:06.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:52:06.812 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:52:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:52:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 msgr2=0x7fd928068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 0x7fd928068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9380af000 tx=0x7fd9380b2040 comp rx=0 tx=0).stop 2023-06-23T18:52:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 msgr2=0x7fd948142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c3c0 tx=0x7fd94000c880 comp rx=0 tx=0).stop 2023-06-23T18:52:06.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 shutdown_connections 2023-06-23T18:52:06.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd928066280 0x7fd928068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9480bee10 0x7fd948142e90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9480bea40 0x7fd948142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 --2- 172.21.15.38:0/631792280 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9480a30c0 0x7fd948148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 >> 172.21.15.38:0/631792280 conn(0x7fd9480a5cc0 msgr2=0x7fd948149c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 shutdown_connections 2023-06-23T18:52:06.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.806+0000 7fd94cd5e640 1 -- 172.21.15.38:0/631792280 wait complete. 2023-06-23T18:52:06.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:52:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.950+0000 7f77020b7640 1 Processor -- start 2023-06-23T18:52:06.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.950+0000 7f77020b7640 1 -- start start 2023-06-23T18:52:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f77020b7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 0x7f76fc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f77020b7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f77020b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc0b9ca0 con 0x7f76fc06c6d0 2023-06-23T18:52:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f77020b7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc0a55b0 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f77020b7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0714a0 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34756/0 (socket says 172.21.15.38:34756) 2023-06-23T18:52:06.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 -- 172.21.15.38:0/1321199780 learned_addr learned my addr 172.21.15.38:0/1321199780 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76faffd640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 0x7f76fc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 -- 172.21.15.38:0/1321199780 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 msgr2=0x7f76fc070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 0x7f76fc070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 -- 172.21.15.38:0/1321199780 >> v1:172.21.15.81:6789/0 conn(0x7f76fc06c6d0 legacy=0x7f76fc0a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 -- 172.21.15.38:0/1321199780 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc06a3f0 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76faffd640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 0x7f76fc070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:52:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fbfff640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76f400d150 tx=0x7f76f401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ff55f62ecd0a88 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fa7fc640 1 -- 172.21.15.38:0/1321199780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400b2d0 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fa7fc640 1 -- 172.21.15.38:0/1321199780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76f400b430 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.954+0000 7f76fa7fc640 1 -- 172.21.15.38:0/1321199780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40a7b90 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/1321199780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bc4f0 msgr2=0x7f76fc14a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76f400d150 tx=0x7f76f401eb80 comp rx=0 tx=0).stop 2023-06-23T18:52:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/1321199780 shutdown_connections 2023-06-23T18:52:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bc4f0 0x7f76fc14a4a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- 172.21.15.38:0/1321199780 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bd9b0 0x7f76fc070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/1321199780 >> 172.21.15.38:0/1321199780 conn(0x7f76fc0c0c90 msgr2=0x7f76fc0bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:06.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/1321199780 shutdown_connections 2023-06-23T18:52:06.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/1321199780 wait complete. 2023-06-23T18:52:06.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 Processor -- start 2023-06-23T18:52:06.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- start start 2023-06-23T18:52:06.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76fc06c6d0 0x7f76fc1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bc4f0 0x7f76fc14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc149c10 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1413c0 con 0x7f76fc06c6d0 2023-06-23T18:52:06.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc149260 con 0x7f76fc0bc4f0 2023-06-23T18:52:06.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34764/0 (socket says 172.21.15.38:34764) 2023-06-23T18:52:06.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 -- 172.21.15.38:0/3592483325 learned_addr learned my addr 172.21.15.38:0/3592483325 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:06.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76faffd640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bc4f0 0x7f76fc14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fb7fe640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76fc06c6d0 0x7f76fc1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 -- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bc4f0 msgr2=0x7f76fc14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bc4f0 0x7f76fc14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 -- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76fc06c6d0 msgr2=0x7f76fc1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:06.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76fc06c6d0 0x7f76fc1489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 -- 172.21.15.38:0/3592483325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f400bd40 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76fbfff640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f76f40b1040 tx=0x7f76f401b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4009800 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76f4009960 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc1415f0 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4009cf0 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.958+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc141af0 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc149760 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76f40ba470 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f76e3fff640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 0x7f76e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:06.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76f4121a60 con 0x7f76fc0bd9b0 2023-06-23T18:52:06.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f76fb7fe640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 0x7f76e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:06.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.962+0000 7f76fb7fe640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 0x7f76e8068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000f70 tx=0x7f76ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:06.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:06.966+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76f40eebd0 con 0x7f76fc0bd9b0 2023-06-23T18:52:07.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.146+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76fc149760 con 0x7f76fc0bd9b0 2023-06-23T18:52:07.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f76e3fff640 1 -- 172.21.15.38:0/3592483325 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3155 (secure 0 0 0) 0x7f76fc149760 con 0x7f76fc0bd9b0 2023-06-23T18:52:07.155 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:52:07.155 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3076071059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3076071059},{"type":"v1","addr":"172.21.15.81:6835","nonce":3076071059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:49:36.741321+0000","modified":"2023-06-23T18:49:53.368155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/4127630669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4127630669},{"type":"v1","addr":"172.21.15.38:6833","nonce":4127630669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:52:07.156 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-06-23T18:52:07.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 msgr2=0x7f76e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 0x7f76e8068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000f70 tx=0x7f76ec009040 comp rx=0 tx=0).stop 2023-06-23T18:52:07.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 msgr2=0x7f76fc14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f76f40b1040 tx=0x7f76f401b920 comp rx=0 tx=0).stop 2023-06-23T18:52:07.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 shutdown_connections 2023-06-23T18:52:07.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f76e8066280 0x7f76e8068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0bd9b0 0x7f76fc14d6d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f76fc0bc4f0 0x7f76fc14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 --2- 172.21.15.38:0/3592483325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76fc06c6d0 0x7f76fc1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 >> 172.21.15.38:0/3592483325 conn(0x7f76fc0c0c90 msgr2=0x7f76fc145d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:07.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 shutdown_connections 2023-06-23T18:52:07.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.150+0000 7f77020b7640 1 -- 172.21.15.38:0/3592483325 wait complete. 2023-06-23T18:52:07.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:52:07.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 Processor -- start 2023-06-23T18:52:07.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 -- start start 2023-06-23T18:52:07.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 0x7fc774158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7740bb6b0 con 0x7fc7740bc5c0 2023-06-23T18:52:07.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7740bbb40 con 0x7fc77406e8e0 2023-06-23T18:52:07.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc779af8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77406f310 con 0x7fc774152030 2023-06-23T18:52:07.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc7737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc773fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 0x7fc774158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc7737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.38:48140/0 (socket says 172.21.15.38:48140) 2023-06-23T18:52:07.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc772ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc7740bc5c0 0x7fc774151920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.38:53988/0 (socket says 172.21.15.38:53988) 2023-06-23T18:52:07.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc7737fe640 1 -- 172.21.15.38:0/410257625 learned_addr learned my addr 172.21.15.38:0/410257625 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:07.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc773fff640 1 -- 172.21.15.38:0/410257625 >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 msgr2=0x7fc7740bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:07.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc773fff640 1 --2- 172.21.15.38:0/410257625 >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc773fff640 1 -- 172.21.15.38:0/410257625 >> v1:172.21.15.81:6789/0 conn(0x7fc7740bc5c0 legacy=0x7fc774151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc773fff640 1 -- 172.21.15.38:0/410257625 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77414e260 con 0x7fc774152030 2023-06-23T18:52:07.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.290+0000 7fc7737fe640 1 --2- 172.21.15.38:0/410257625 >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:52:07.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc773fff640 1 --2- 172.21.15.38:0/410257625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 0x7fc774158c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f9bb313cfa76f0b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc7727fc640 1 -- 172.21.15.38:0/410257625 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640a5890 con 0x7fc774152030 2023-06-23T18:52:07.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc7727fc640 1 -- 172.21.15.38:0/410257625 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7640a59f0 con 0x7fc774152030 2023-06-23T18:52:07.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc7727fc640 1 -- 172.21.15.38:0/410257625 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640a5da0 con 0x7fc774152030 2023-06-23T18:52:07.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- 172.21.15.38:0/410257625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 msgr2=0x7fc774158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- 172.21.15.38:0/410257625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 0x7fc774158c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76401c8c0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- 172.21.15.38:0/410257625 shutdown_connections 2023-06-23T18:52:07.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- 172.21.15.38:0/410257625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc774152030 0x7fc774158c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- 172.21.15.38:0/410257625 >> v2:172.21.15.81:3300/0 conn(0x7fc77406e8e0 0x7fc7740bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- 172.21.15.38:0/410257625 >> 172.21.15.38:0/410257625 conn(0x7fc7740c14a0 msgr2=0x7fc7740bd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:07.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- 172.21.15.38:0/410257625 shutdown_connections 2023-06-23T18:52:07.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- 172.21.15.38:0/410257625 wait complete. 2023-06-23T18:52:07.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 Processor -- start 2023-06-23T18:52:07.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- start start 2023-06-23T18:52:07.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 0x7fc774145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 0x7fc774150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774146e10 con 0x7fc774152030 2023-06-23T18:52:07.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7741470f0 con 0x7fc7740bc5c0 2023-06-23T18:52:07.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc779af8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7741514d0 con 0x7fc77406e8e0 2023-06-23T18:52:07.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc773fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.294+0000 7fc773fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34778/0 (socket says 172.21.15.38:34778) 2023-06-23T18:52:07.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 -- 172.21.15.38:0/832068708 learned_addr learned my addr 172.21.15.38:0/832068708 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:07.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc7737fe640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 0x7fc774145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc772ffd640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 0x7fc774150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 -- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 msgr2=0x7fc774145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 0x7fc774145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 -- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 msgr2=0x7fc774150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 0x7fc774150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 -- 172.21.15.38:0/832068708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0094d0 con 0x7fc774152030 2023-06-23T18:52:07.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc7737fe640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 0x7fc774145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:52:07.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc772ffd640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 0x7fc774150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:52:07.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc773fff640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc76401a4f0 tx=0x7fc764019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640ae8e0 con 0x7fc774152030 2023-06-23T18:52:07.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7640aea60 con 0x7fc774152030 2023-06-23T18:52:07.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc764009a70 con 0x7fc774152030 2023-06-23T18:52:07.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640aee30 con 0x7fc774152030 2023-06-23T18:52:07.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7740b6370 con 0x7fc774152030 2023-06-23T18:52:07.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774145bd0 con 0x7fc774152030 2023-06-23T18:52:07.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7640b4050 con 0x7fc774152030 2023-06-23T18:52:07.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 0x7fc754068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc76411f4f0 con 0x7fc774152030 2023-06-23T18:52:07.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc7737fe640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 0x7fc754068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.298+0000 7fc7737fe640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 0x7fc754068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009d30 tx=0x7fc76c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.302+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc774145bd0 con 0x7fc774152030 2023-06-23T18:52:07.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.454+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc774145bd0 con 0x7fc774152030 2023-06-23T18:52:07.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc76bfff640 1 -- 172.21.15.38:0/832068708 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20146 (secure 0 0 0) 0x7fc774145bd0 con 0x7fc774152030 2023-06-23T18:52:07.467 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-23T18:52:07.468 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"6e27767f-b3a9-4e2a-8d3e-c6a80efd1ae5","created":"2023-06-23T18:49:12.600783+0000","modified":"2023-06-23T18:49:41.168997+0000","last_up_change":"2023-06-23T18:49:23.322678+0000","last_in_change":"2023-06-23T18:49:14.917601+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T18:49:23.322583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T18:49:30.802990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:49:35.167229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:49:35.710394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-23T18:49:38.811823+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77559a57-3ed0-4210-9376-f6500d04bed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6820","nonce":575541123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6823","nonce":575541123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6829","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6830","nonce":575541123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6825","nonce":575541123},{"type":"v1","addr":"172.21.15.38:6827","nonce":575541123}]},"public_addr":"172.21.15.38:6820/575541123","cluster_addr":"172.21.15.38:6823/575541123","heartbeat_back_addr":"172.21.15.38:6830/575541123","heartbeat_front_addr":"172.21.15.38:6827/575541123","state":["exists","up"]},{"osd":1,"uuid":"8da635ff-1df9-4f93-bb2d-02c15192d51d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6801","nonce":978431787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6803","nonce":978431787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6807","nonce":978431787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":978431787},{"type":"v1","addr":"172.21.15.38:6805","nonce":978431787}]},"public_addr":"172.21.15.38:6801/978431787","cluster_addr":"172.21.15.38:6803/978431787","heartbeat_back_addr":"172.21.15.38:6807/978431787","heartbeat_front_addr":"172.21.15.38:6805/978431787","state":["exists","up"]},{"osd":2,"uuid":"f425f8c9-a012-421e-b499-1531b8eb349b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6809","nonce":1605176588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6811","nonce":1605176588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6815","nonce":1605176588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":1605176588},{"type":"v1","addr":"172.21.15.38:6813","nonce":1605176588}]},"public_addr":"172.21.15.38:6809/1605176588","cluster_addr":"172.21.15.38:6811/1605176588","heartbeat_back_addr":"172.21.15.38:6815/1605176588","heartbeat_front_addr":"172.21.15.38:6813/1605176588","state":["exists","up"]},{"osd":3,"uuid":"68c73311-17ba-4bbb-832d-094c342ee8a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6817","nonce":1363740470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6819","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6821","nonce":1363740470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6831","nonce":1363740470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1363740470},{"type":"v1","addr":"172.21.15.38:6826","nonce":1363740470}]},"public_addr":"172.21.15.38:6817/1363740470","cluster_addr":"172.21.15.38:6821/1363740470","heartbeat_back_addr":"172.21.15.38:6831/1363740470","heartbeat_front_addr":"172.21.15.38:6826/1363740470","state":["exists","up"]},{"osd":4,"uuid":"499250a5-02f7-4465-9821-18e5228413bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6801","nonce":933345311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6803","nonce":933345311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6807","nonce":933345311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":933345311},{"type":"v1","addr":"172.21.15.81:6805","nonce":933345311}]},"public_addr":"172.21.15.81:6801/933345311","cluster_addr":"172.21.15.81:6803/933345311","heartbeat_back_addr":"172.21.15.81:6807/933345311","heartbeat_front_addr":"172.21.15.81:6805/933345311","state":["exists","up"]},{"osd":5,"uuid":"d249bd2b-827b-4d00-8998-325cfac702bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6809","nonce":3054646995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6811","nonce":3054646995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6815","nonce":3054646995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3054646995},{"type":"v1","addr":"172.21.15.81:6813","nonce":3054646995}]},"public_addr":"172.21.15.81:6809/3054646995","cluster_addr":"172.21.15.81:6811/3054646995","heartbeat_back_addr":"172.21.15.81:6815/3054646995","heartbeat_front_addr":"172.21.15.81:6813/3054646995","state":["exists","up"]},{"osd":6,"uuid":"901d85cc-2b2b-457d-b22f-616ce27eab98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6817","nonce":3000886383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6819","nonce":3000886383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6823","nonce":3000886383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3000886383},{"type":"v1","addr":"172.21.15.81:6821","nonce":3000886383}]},"public_addr":"172.21.15.81:6817/3000886383","cluster_addr":"172.21.15.81:6819/3000886383","heartbeat_back_addr":"172.21.15.81:6823/3000886383","heartbeat_front_addr":"172.21.15.81:6821/3000886383","state":["exists","up"]},{"osd":7,"uuid":"5a50352f-25ca-4116-b04f-bbd2400a26b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6825","nonce":3767203985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6827","nonce":3767203985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6831","nonce":3767203985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3767203985},{"type":"v1","addr":"172.21.15.81:6829","nonce":3767203985}]},"public_addr":"172.21.15.81:6825/3767203985","cluster_addr":"172.21.15.81:6827/3767203985","heartbeat_back_addr":"172.21.15.81:6831/3767203985","heartbeat_front_addr":"172.21.15.81:6829/3767203985","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.507970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.403472+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.520684+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.561205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.475289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:19.819556+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.589736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:49:20.516637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:52:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 msgr2=0x7fc754068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 0x7fc754068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009d30 tx=0x7fc76c008040 comp rx=0 tx=0).stop 2023-06-23T18:52:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 msgr2=0x7fc7741e9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc76401a4f0 tx=0x7fc764019660 comp rx=0 tx=0).stop 2023-06-23T18:52:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 shutdown_connections 2023-06-23T18:52:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc754066280 0x7fc754068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc774152030 0x7fc7741e9b40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740bc5c0 0x7fc774150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 --2- 172.21.15.38:0/832068708 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc77406e8e0 0x7fc774145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 >> 172.21.15.38:0/832068708 conn(0x7fc7740c14a0 msgr2=0x7fc774069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 shutdown_connections 2023-06-23T18:52:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.462+0000 7fc779af8640 1 -- 172.21.15.38:0/832068708 wait complete. 2023-06-23T18:52:07.485 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-23T18:52:07.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 Processor -- start 2023-06-23T18:52:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 -- start start 2023-06-23T18:52:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f42f40a4e30 0x7f42f406e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f406f2d0 con 0x7f42f4149eb0 2023-06-23T18:52:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f406a4c0 con 0x7f42f4071220 2023-06-23T18:52:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f922b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f406a7a0 con 0x7f42f40a4e30 2023-06-23T18:52:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f42f40a4e30 0x7f42f406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f2d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f42f4149eb0 0x7f42f40bd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52904/0 (socket says 172.21.15.38:52904) 2023-06-23T18:52:07.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f2d9d640 1 -- 172.21.15.38:0/4250612240 learned_addr learned my addr 172.21.15.38:0/4250612240 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:07.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f1d9b640 1 -- 172.21.15.38:0/4250612240 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650455373 0 0) 0x7f42f406f2d0 con 0x7f42f4149eb0 2023-06-23T18:52:07.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f1d9b640 1 -- 172.21.15.38:0/4250612240 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42dc003530 con 0x7f42f4149eb0 2023-06-23T18:52:07.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f259c640 1 -- 172.21.15.38:0/4250612240 >> v1:172.21.15.81:6789/0 conn(0x7f42f4071220 legacy=0x7f42f414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:07.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f259c640 1 -- 172.21.15.38:0/4250612240 >> v1:172.21.15.38:6789/0 conn(0x7f42f4149eb0 legacy=0x7f42f40bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.598+0000 7f42f259c640 1 -- 172.21.15.38:0/4250612240 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f414a9a0 con 0x7f42f40a4e30 2023-06-23T18:52:07.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f259c640 1 --2- 172.21.15.38:0/4250612240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f40a4e30 0x7f42f406e050 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42e800a960 tx=0x7f42e801d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7eb0c48514fd6a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f1d9b640 1 -- 172.21.15.38:0/4250612240 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a67f0 con 0x7f42f40a4e30 2023-06-23T18:52:07.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f1d9b640 1 -- 172.21.15.38:0/4250612240 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f42e80a6950 con 0x7f42f40a4e30 2023-06-23T18:52:07.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f1d9b640 1 -- 172.21.15.38:0/4250612240 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a6d00 con 0x7f42f40a4e30 2023-06-23T18:52:07.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- 172.21.15.38:0/4250612240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f40a4e30 msgr2=0x7f42f406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 --2- 172.21.15.38:0/4250612240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f40a4e30 0x7f42f406e050 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f42e800a960 tx=0x7f42e801d810 comp rx=0 tx=0).stop 2023-06-23T18:52:07.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- 172.21.15.38:0/4250612240 shutdown_connections 2023-06-23T18:52:07.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 --2- 172.21.15.38:0/4250612240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f40a4e30 0x7f42f406e050 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- 172.21.15.38:0/4250612240 >> 172.21.15.38:0/4250612240 conn(0x7f42f40c0c90 msgr2=0x7f42f40bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:07.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- 172.21.15.38:0/4250612240 shutdown_connections 2023-06-23T18:52:07.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- 172.21.15.38:0/4250612240 wait complete. 2023-06-23T18:52:07.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 Processor -- start 2023-06-23T18:52:07.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.602+0000 7f42f922b640 1 -- start start 2023-06-23T18:52:07.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42f4071220 0x7f42f41443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42f40a4e30 0x7f42f413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40bbcc0 con 0x7f42f4149eb0 2023-06-23T18:52:07.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f413c3e0 con 0x7f42f40a4e30 2023-06-23T18:52:07.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f413dbe0 con 0x7f42f4071220 2023-06-23T18:52:07.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34786/0 (socket says 172.21.15.38:34786) 2023-06-23T18:52:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 -- 172.21.15.38:0/1760278089 learned_addr learned my addr 172.21.15.38:0/1760278089 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f2d9d640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42f4071220 0x7f42f41443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f259c640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42f40a4e30 0x7f42f413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 -- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42f4071220 msgr2=0x7f42f41443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42f4071220 0x7f42f41443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 -- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42f40a4e30 msgr2=0x7f42f413d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:07.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42f40a4e30 0x7f42f413d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:07.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 -- 172.21.15.38:0/1760278089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e800a5c0 con 0x7f42f4149eb0 2023-06-23T18:52:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f359e640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c780 tx=0x7f42ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004b70 con 0x7f42f4149eb0 2023-06-23T18:52:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f42ec00ce90 con 0x7f42f4149eb0 2023-06-23T18:52:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f413cae0 con 0x7f42f4149eb0 2023-06-23T18:52:07.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00a850 con 0x7f42f4149eb0 2023-06-23T18:52:07.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f414ea60 con 0x7f42f4149eb0 2023-06-23T18:52:07.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f413c590 con 0x7f42f4149eb0 2023-06-23T18:52:07.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42ec00a9b0 con 0x7f42f4149eb0 2023-06-23T18:52:07.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 0x7f42e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:07.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42ec0841c0 con 0x7f42f4149eb0 2023-06-23T18:52:07.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.606+0000 7f42f2d9d640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 0x7f42e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:07.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.610+0000 7f42f2d9d640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 0x7f42e0068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42e40011f0 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:07.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.610+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42f413c590 con 0x7f42f4149eb0 2023-06-23T18:52:07.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:07.802+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f42f413c590 con 0x7f42f4149eb0 2023-06-23T18:52:08.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.478+0000 7f42db7fe640 1 -- 172.21.15.38:0/1760278089 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f42f413c590 con 0x7f42f4149eb0 2023-06-23T18:52:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-23T18:52:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 msgr2=0x7f42e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 0x7f42e0068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42e40011f0 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2023-06-23T18:52:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 msgr2=0x7f42f414bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c780 tx=0x7f42ec00cc40 comp rx=0 tx=0).stop 2023-06-23T18:52:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 shutdown_connections 2023-06-23T18:52:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7f42e0066280 0x7f42e0068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42f4149eb0 0x7f42f414bc90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42f40a4e30 0x7f42f413d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 --2- 172.21.15.38:0/1760278089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42f4071220 0x7f42f41443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 >> 172.21.15.38:0/1760278089 conn(0x7f42f40c0c90 msgr2=0x7f42f414aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 shutdown_connections 2023-06-23T18:52:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.482+0000 7f42f922b640 1 -- 172.21.15.38:0/1760278089 wait complete. 2023-06-23T18:52:08.492 INFO:tasks.ceph.mds.a.smithi038.stderr: -5889> 2023-06-23T18:49:37.463+0000 7f819c00f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T18:52:08.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-23T18:52:08.540 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-06-23T18:52:08.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 Processor -- start 2023-06-23T18:52:08.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 -- start start 2023-06-23T18:52:08.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe080be9f0 0x7efe080a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080a3290 con 0x7efe080bedc0 2023-06-23T18:52:08.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080c28f0 con 0x7efe080c30b0 2023-06-23T18:52:08.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0e6ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080b78f0 con 0x7efe080be9f0 2023-06-23T18:52:08.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe077fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efe080bedc0 0x7efe080c0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52912/0 (socket says 172.21.15.38:52912) 2023-06-23T18:52:08.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe077fe640 1 -- 172.21.15.38:0/81400782 learned_addr learned my addr 172.21.15.38:0/81400782 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:08.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe07fff640 1 --2- 172.21.15.38:0/81400782 >> v2:172.21.15.81:3300/0 conn(0x7efe080be9f0 0x7efe080a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520544692 0 0) 0x7efe080a3290 con 0x7efe080bedc0 2023-06-23T18:52:08.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0003530 con 0x7efe080bedc0 2023-06-23T18:52:08.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758009432 0 0) 0x7efdf0003530 con 0x7efe080bedc0 2023-06-23T18:52:08.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 >> v2:172.21.15.81:3300/0 conn(0x7efe080be9f0 msgr2=0x7efe080a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:08.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 --2- 172.21.15.38:0/81400782 >> v2:172.21.15.81:3300/0 conn(0x7efe080be9f0 0x7efe080a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 >> v1:172.21.15.81:6789/0 conn(0x7efe080c30b0 legacy=0x7efe081518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080b7a30 con 0x7efe080bedc0 2023-06-23T18:52:08.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7efdfc001680 con 0x7efe080bedc0 2023-06-23T18:52:08.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 >> v1:172.21.15.38:6789/0 conn(0x7efe080bedc0 legacy=0x7efe080c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdf0003980 0x7efdf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf00047d0 0x7efdf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efdf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080b78f0 con 0x7efdf0005180 2023-06-23T18:52:08.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000c000 con 0x7efdf00047d0 2023-06-23T18:52:08.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000c1c0 con 0x7efdf0003980 2023-06-23T18:52:08.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.630+0000 7efe0cc8a640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efdf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe077fe640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf00047d0 0x7efdf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe07fff640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdf0003980 0x7efdf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 -- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdf0003980 msgr2=0x7efdf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:08.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdf0003980 0x7efdf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 -- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf00047d0 msgr2=0x7efdf0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:08.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf00047d0 0x7efdf0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 -- 172.21.15.38:0/81400782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0003530 con 0x7efdf0005180 2023-06-23T18:52:08.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe07fff640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdf0003980 0x7efdf0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:52:08.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 -- 172.21.15.38:0/81400782 reap_dead start 2023-06-23T18:52:08.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0cc8a640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efdf000b990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdf8001780 tx=0x7efdf801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa0f01ced659288 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:08.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80052d0 con 0x7efdf0005180 2023-06-23T18:52:08.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efdf80a7050 con 0x7efdf0005180 2023-06-23T18:52:08.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe06ffd640 1 -- 172.21.15.38:0/81400782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8003600 con 0x7efdf0005180 2023-06-23T18:52:08.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 -- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 msgr2=0x7efdf000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efdf000b990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdf8001780 tx=0x7efdf801c400 comp rx=0 tx=0).stop 2023-06-23T18:52:08.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 -- 172.21.15.38:0/81400782 shutdown_connections 2023-06-23T18:52:08.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/81400782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efdf000b990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 -- 172.21.15.38:0/81400782 >> 172.21.15.38:0/81400782 conn(0x7efe08060b10 msgr2=0x7efe080a5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:08.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 -- 172.21.15.38:0/81400782 shutdown_connections 2023-06-23T18:52:08.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.634+0000 7efe0e6ed640 1 -- 172.21.15.38:0/81400782 wait complete. 2023-06-23T18:52:08.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 Processor -- start 2023-06-23T18:52:08.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- start start 2023-06-23T18:52:08.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe080bdff0 0x7efe080a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe080a50c0 0x7efe080b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080b7330 con 0x7efdf0005180 2023-06-23T18:52:08.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081e2fe0 con 0x7efe080a50c0 2023-06-23T18:52:08.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe081e3220 con 0x7efe080bdff0 2023-06-23T18:52:08.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34828/0 (socket says 172.21.15.38:34828) 2023-06-23T18:52:08.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 -- 172.21.15.38:0/1189672534 learned_addr learned my addr 172.21.15.38:0/1189672534 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:08.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe077fe640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe080bdff0 0x7efe080a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0cc8a640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe080a50c0 0x7efe080b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 -- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe080bdff0 msgr2=0x7efe080a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe080bdff0 0x7efe080a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 -- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe080a50c0 msgr2=0x7efe080b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:08.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe080a50c0 0x7efe080b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:08.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 -- 172.21.15.38:0/1189672534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe081e3500 con 0x7efdf0005180 2023-06-23T18:52:08.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe07fff640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efe00007e50 tx=0x7efe00010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:08.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0000e050 con 0x7efdf0005180 2023-06-23T18:52:08.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efe0000f040 con 0x7efdf0005180 2023-06-23T18:52:08.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe081e3f60 con 0x7efdf0005180 2023-06-23T18:52:08.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00003be0 con 0x7efdf0005180 2023-06-23T18:52:08.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0806b300 con 0x7efdf0005180 2023-06-23T18:52:08.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0804d790 con 0x7efdf0005180 2023-06-23T18:52:08.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.638+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe00003d40 con 0x7efdf0005180 2023-06-23T18:52:08.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.642+0000 7efe04ff9640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:08.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.642+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7efe00084d60 con 0x7efdf0005180 2023-06-23T18:52:08.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.642+0000 7efe077fe640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:08.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.642+0000 7efe077fe640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 0x7efdf4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efdfc001060 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:08.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.646+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe00055890 con 0x7efdf0005180 2023-06-23T18:52:08.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:08.838+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efe081e3690 con 0x7efdf0005180 2023-06-23T18:52:09.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.494+0000 7efe04ff9640 1 -- 172.21.15.38:0/1189672534 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7efe00055420 con 0x7efdf0005180 2023-06-23T18:52:09.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 msgr2=0x7efdf4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 0x7efdf4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efdfc001060 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2023-06-23T18:52:09.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 msgr2=0x7efe081e3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efe00007e50 tx=0x7efe00010590 comp rx=0 tx=0).stop 2023-06-23T18:52:09.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 shutdown_connections 2023-06-23T18:52:09.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe080a50c0 0x7efe080b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe080bdff0 0x7efe080a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 --2- 172.21.15.38:0/1189672534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdf0005180 0x7efe081e3a20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 >> 172.21.15.38:0/1189672534 conn(0x7efe08060b10 msgr2=0x7efe0814c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:09.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 shutdown_connections 2023-06-23T18:52:09.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.498+0000 7efe0e6ed640 1 -- 172.21.15.38:0/1189672534 wait complete. 2023-06-23T18:52:09.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-23T18:52:09.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 Processor -- start 2023-06-23T18:52:09.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 -- start start 2023-06-23T18:52:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc63006c6d0 0x7fc630070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc6300bd9b0 0x7fc6300a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300b9ca0 con 0x7fc6300bc4f0 2023-06-23T18:52:09.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300714a0 con 0x7fc6300bd9b0 2023-06-23T18:52:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc63554c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63006a3f0 con 0x7fc63006c6d0 2023-06-23T18:52:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc6300bc4f0 0x7fc63014a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52918/0 (socket says 172.21.15.38:52918) 2023-06-23T18:52:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62e7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc6300bd9b0 0x7fc6300a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62f7fe640 1 -- 172.21.15.38:0/1045030567 learned_addr learned my addr 172.21.15.38:0/1045030567 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62effd640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc63006c6d0 0x7fc630070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62dffb640 1 -- 172.21.15.38:0/1045030567 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556408095 0 0) 0x7fc6300b9ca0 con 0x7fc6300bc4f0 2023-06-23T18:52:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62dffb640 1 -- 172.21.15.38:0/1045030567 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc618003530 con 0x7fc6300bc4f0 2023-06-23T18:52:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62e7fc640 1 -- 172.21.15.38:0/1045030567 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc63006c6d0 msgr2=0x7fc630070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc63006c6d0 0x7fc630070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62e7fc640 1 -- 172.21.15.38:0/1045030567 >> v1:172.21.15.38:6789/0 conn(0x7fc6300bc4f0 legacy=0x7fc63014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.702+0000 7fc62e7fc640 1 -- 172.21.15.38:0/1045030567 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300ba390 con 0x7fc6300bd9b0 2023-06-23T18:52:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300bd9b0 0x7fc6300a4ea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc6240097c0 tx=0x7fc62401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963a21bb2c131857 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62dffb640 1 -- 172.21.15.38:0/1045030567 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240ab600 con 0x7fc6300bd9b0 2023-06-23T18:52:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62dffb640 1 -- 172.21.15.38:0/1045030567 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6240a7050 con 0x7fc6300bd9b0 2023-06-23T18:52:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62dffb640 1 -- 172.21.15.38:0/1045030567 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240ab960 con 0x7fc6300bd9b0 2023-06-23T18:52:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- 172.21.15.38:0/1045030567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300bd9b0 msgr2=0x7fc6300a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300bd9b0 0x7fc6300a4ea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc6240097c0 tx=0x7fc62401c3f0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- 172.21.15.38:0/1045030567 shutdown_connections 2023-06-23T18:52:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300bd9b0 0x7fc6300a4ea0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- 172.21.15.38:0/1045030567 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc63006c6d0 0x7fc630070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- 172.21.15.38:0/1045030567 >> 172.21.15.38:0/1045030567 conn(0x7fc6300c0c90 msgr2=0x7fc6300bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- 172.21.15.38:0/1045030567 shutdown_connections 2023-06-23T18:52:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- 172.21.15.38:0/1045030567 wait complete. 2023-06-23T18:52:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 Processor -- start 2023-06-23T18:52:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- start start 2023-06-23T18:52:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 0x7fc63014dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6300bd9b0 0x7fc630146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63013f420 con 0x7fc63006c6d0 2023-06-23T18:52:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63014f550 con 0x7fc6300bd9b0 2023-06-23T18:52:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc63554c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63013f8c0 con 0x7fc6300bc4f0 2023-06-23T18:52:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.706+0000 7fc62effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34846/0 (socket says 172.21.15.38:34846) 2023-06-23T18:52:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 -- 172.21.15.38:0/3753933115 learned_addr learned my addr 172.21.15.38:0/3753933115 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 0x7fc63014dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 -- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 msgr2=0x7fc63014dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 0x7fc63014dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62f7fe640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6300bd9b0 0x7fc630146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 -- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6300bd9b0 msgr2=0x7fc630146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6300bd9b0 0x7fc630146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 -- 172.21.15.38:0/3753933115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009420 con 0x7fc63006c6d0 2023-06-23T18:52:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 0x7fc63014dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:52:09.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62effd640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc62000d5f0 tx=0x7fc62000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:09.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200125f0 con 0x7fc63006c6d0 2023-06-23T18:52:09.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc620012750 con 0x7fc63006c6d0 2023-06-23T18:52:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63013f5e0 con 0x7fc63006c6d0 2023-06-23T18:52:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012b00 con 0x7fc63006c6d0 2023-06-23T18:52:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630140080 con 0x7fc63006c6d0 2023-06-23T18:52:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63004d790 con 0x7fc63006c6d0 2023-06-23T18:52:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc620012c60 con 0x7fc63006c6d0 2023-06-23T18:52:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 0x7fc61c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7fc6200845d0 con 0x7fc63006c6d0 2023-06-23T18:52:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 0x7fc61c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.710+0000 7fc62e7fc640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 0x7fc61c068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6240ad000 tx=0x7fc6240a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.714+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc620051700 con 0x7fc63006c6d0 2023-06-23T18:52:09.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:09.870+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc63006f990 con 0x7fc63006c6d0 2023-06-23T18:52:10.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.514+0000 7fc6177fe640 1 -- 172.21.15.38:0/3753933115 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc620054d20 con 0x7fc63006c6d0 2023-06-23T18:52:10.521 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-06-23T18:52:10.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 msgr2=0x7fc61c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 0x7fc61c068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc6240ad000 tx=0x7fc6240a4f90 comp rx=0 tx=0).stop 2023-06-23T18:52:10.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 msgr2=0x7fc630143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc62000d5f0 tx=0x7fc62000dab0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 shutdown_connections 2023-06-23T18:52:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fc61c066280 0x7fc61c068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6300bd9b0 0x7fc630146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc6300bc4f0 0x7fc63014dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 --2- 172.21.15.38:0/3753933115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc63006c6d0 0x7fc630143090 secure :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc62000d5f0 tx=0x7fc62000dab0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.518+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 >> 172.21.15.38:0/3753933115 conn(0x7fc6300c0c90 msgr2=0x7fc6300ba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:10.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.522+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 shutdown_connections 2023-06-23T18:52:10.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.522+0000 7fc63554c640 1 -- 172.21.15.38:0/3753933115 wait complete. 2023-06-23T18:52:10.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-23T18:52:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 Processor -- start 2023-06-23T18:52:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 -- start start 2023-06-23T18:52:10.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a0070a30 0x7fd9a0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a014eda0 con 0x7fd9a006d570 2023-06-23T18:52:10.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a006ea50 con 0x7fd9a006b120 2023-06-23T18:52:10.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd9a5596640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a014ea30 con 0x7fd9a0070a30 2023-06-23T18:52:10.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd9a006d570 0x7fd9a006d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52930/0 (socket says 172.21.15.38:52930) 2023-06-23T18:52:10.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99f7fe640 1 -- 172.21.15.38:0/1281556355 learned_addr learned my addr 172.21.15.38:0/1281556355 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-06-23T18:52:10.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99e7fc640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a0070a30 0x7fd9a0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118089232 0 0) 0x7fd9a014eda0 con 0x7fd9a006d570 2023-06-23T18:52:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd988003530 con 0x7fd9a006d570 2023-06-23T18:52:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465165527 0 0) 0x7fd9a006ea50 con 0x7fd9a006b120 2023-06-23T18:52:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a014eda0 con 0x7fd9a006b120 2023-06-23T18:52:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642577296 0 0) 0x7fd988003530 con 0x7fd9a006d570 2023-06-23T18:52:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a0070a30 msgr2=0x7fd9a0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:10.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a0070a30 0x7fd9a0070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 >> v1:172.21.15.81:6789/0 conn(0x7fd9a006b120 legacy=0x7fd9a0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0070750 con 0x7fd9a006d570 2023-06-23T18:52:10.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3459370945 0 0) 0x7fd990001680 con 0x7fd9a006d570 2023-06-23T18:52:10.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 >> v1:172.21.15.38:6789/0 conn(0x7fd9a006d570 legacy=0x7fd9a006d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd988003b40 0x7fd988003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9880047d0 0x7fd988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd988005180 0x7fd98800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a014ea30 con 0x7fd988005180 2023-06-23T18:52:10.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98800bed0 con 0x7fd9880047d0 2023-06-23T18:52:10.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98800c090 con 0x7fd988003b40 2023-06-23T18:52:10.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.674+0000 7fd99f7fe640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd988005180 0x7fd98800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99e7fc640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9880047d0 0x7fd988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 -- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd988003b40 msgr2=0x7fd988003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:10.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd988003b40 0x7fd988003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 -- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9880047d0 msgr2=0x7fd988004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:10.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9880047d0 0x7fd988004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 -- 172.21.15.38:0/1281556355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988003530 con 0x7fd988005180 2023-06-23T18:52:10.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd988005180 0x7fd98800b990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c160 tx=0x7fd99001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b53a6a9749c971 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:10.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9900058e0 con 0x7fd988005180 2023-06-23T18:52:10.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd990005a60 con 0x7fd988005180 2023-06-23T18:52:10.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99dffb640 1 -- 172.21.15.38:0/1281556355 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990005e70 con 0x7fd988005180 2023-06-23T18:52:10.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 -- 172.21.15.38:0/1281556355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd988005180 msgr2=0x7fd98800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 --2- 172.21.15.38:0/1281556355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd988005180 0x7fd98800b990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c160 tx=0x7fd99001cbc0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd99f7fe640 1 -- 172.21.15.38:0/1281556355 reap_dead start 2023-06-23T18:52:10.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 -- 172.21.15.38:0/1281556355 shutdown_connections 2023-06-23T18:52:10.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 -- 172.21.15.38:0/1281556355 >> 172.21.15.38:0/1281556355 conn(0x7fd9a00c1fb0 msgr2=0x7fd9a00c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:10.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 -- 172.21.15.38:0/1281556355 shutdown_connections 2023-06-23T18:52:10.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.678+0000 7fd9a5596640 1 -- 172.21.15.38:0/1281556355 wait complete. 2023-06-23T18:52:10.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 Processor -- start 2023-06-23T18:52:10.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- start start 2023-06-23T18:52:10.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a01d5970 0x7fd9a01499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a014a5a0 0x7fd9a014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01e3650 con 0x7fd9a0147c40 2023-06-23T18:52:10.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01e2d70 con 0x7fd9a01d5970 2023-06-23T18:52:10.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01e3fb0 con 0x7fd9a014a5a0 2023-06-23T18:52:10.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34874/0 (socket says 172.21.15.38:34874) 2023-06-23T18:52:10.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 -- 172.21.15.38:0/3812346250 learned_addr learned my addr 172.21.15.38:0/3812346250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:10.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99f7fe640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a014a5a0 0x7fd9a014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99effd640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a01d5970 0x7fd9a01499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 -- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a014a5a0 msgr2=0x7fd9a014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a014a5a0 0x7fd9a014aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 -- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a01d5970 msgr2=0x7fd9a01499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:10.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a01d5970 0x7fd9a01499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:10.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 -- 172.21.15.38:0/3812346250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a01e2f90 con 0x7fd9a0147c40 2023-06-23T18:52:10.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd99e7fc640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd994011660 tx=0x7fd994011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:10.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99400f9c0 con 0x7fd9a0147c40 2023-06-23T18:52:10.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd99400fb20 con 0x7fd9a0147c40 2023-06-23T18:52:10.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a01e3270 con 0x7fd9a0147c40 2023-06-23T18:52:10.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99400feb0 con 0x7fd9a0147c40 2023-06-23T18:52:10.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a0134910 con 0x7fd9a0147c40 2023-06-23T18:52:10.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a014dd40 con 0x7fd9a0147c40 2023-06-23T18:52:10.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.682+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd994015460 con 0x7fd9a0147c40 2023-06-23T18:52:10.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.686+0000 7fd9877fe640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 0x7fd98c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:10.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.686+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6461+0+0 (secure 0 0 0) 0x7fd9940846b0 con 0x7fd9a0147c40 2023-06-23T18:52:10.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.686+0000 7fd99effd640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 0x7fd98c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:10.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.686+0000 7fd99effd640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 0x7fd98c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9980012f0 tx=0x7fd99800c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:10.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.690+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd994051a30 con 0x7fd9a0147c40 2023-06-23T18:52:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:10.842+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9a004d790 con 0x7fd9a0147c40 2023-06-23T18:52:11.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.522+0000 7fd9877fe640 1 -- 172.21.15.38:0/3812346250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd994055050 con 0x7fd9a0147c40 2023-06-23T18:52:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-06-23T18:52:11.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 msgr2=0x7fd98c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 0x7fd98c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9980012f0 tx=0x7fd99800c040 comp rx=0 tx=0).stop 2023-06-23T18:52:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 msgr2=0x7fd9a01e3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd994011660 tx=0x7fd994011b20 comp rx=0 tx=0).stop 2023-06-23T18:52:11.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 shutdown_connections 2023-06-23T18:52:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7fd98c0662b0 0x7fd98c068760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd9a014a5a0 0x7fd9a014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9a0147c40 0x7fd9a01e3a70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 --2- 172.21.15.38:0/3812346250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a01d5970 0x7fd9a01499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.526+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 >> 172.21.15.38:0/3812346250 conn(0x7fd9a00c1fb0 msgr2=0x7fd9a01d8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.530+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 shutdown_connections 2023-06-23T18:52:11.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.530+0000 7fd9a5596640 1 -- 172.21.15.38:0/3812346250 wait complete. 2023-06-23T18:52:11.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-23T18:52:11.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 Processor -- start 2023-06-23T18:52:11.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 -- start start 2023-06-23T18:52:11.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcb40bea40 0x7efcb40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40a30c0 0x7efcb40c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efcb40bee10 0x7efcb406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb4152830 con 0x7efcb40bea40 2023-06-23T18:52:11.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40c22a0 con 0x7efcb40bee10 2023-06-23T18:52:11.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcbbb2a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40c2870 con 0x7efcb40a30c0 2023-06-23T18:52:11.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcb98c6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcb40bea40 0x7efcb40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcb98c6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcb40bea40 0x7efcb40a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34882/0 (socket says 172.21.15.38:34882) 2023-06-23T18:52:11.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.682+0000 7efcb98c6640 1 -- 172.21.15.38:0/178333670 learned_addr learned my addr 172.21.15.38:0/178333670 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcba0c7640 1 --2- 172.21.15.38:0/178333670 >> v2:172.21.15.81:3300/0 conn(0x7efcb40bee10 0x7efcb406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb90c5640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40a30c0 0x7efcb40c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 -- 172.21.15.38:0/178333670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40a30c0 msgr2=0x7efcb40c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40a30c0 0x7efcb40c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 -- 172.21.15.38:0/178333670 >> v2:172.21.15.81:3300/0 conn(0x7efcb40bee10 msgr2=0x7efcb406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:52:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 --2- 172.21.15.38:0/178333670 >> v2:172.21.15.81:3300/0 conn(0x7efcb40bee10 0x7efcb406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 -- 172.21.15.38:0/178333670 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40b7950 con 0x7efcb40bea40 2023-06-23T18:52:11.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb98c6640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40a35f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efcb40c5270 tx=0x7efcb001c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0820c7b71fe036 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:11.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb88c4640 1 -- 172.21.15.38:0/178333670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00ab600 con 0x7efcb40bea40 2023-06-23T18:52:11.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb88c4640 1 -- 172.21.15.38:0/178333670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efcb00a7050 con 0x7efcb40bea40 2023-06-23T18:52:11.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcb88c4640 1 -- 172.21.15.38:0/178333670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00ab9a0 con 0x7efcb40bea40 2023-06-23T18:52:11.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 -- 172.21.15.38:0/178333670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 msgr2=0x7efcb40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:11.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40a35f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efcb40c5270 tx=0x7efcb001c1b0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 -- 172.21.15.38:0/178333670 shutdown_connections 2023-06-23T18:52:11.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/178333670 >> v2:172.21.15.81:3300/0 conn(0x7efcb40bee10 0x7efcb406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40a30c0 0x7efcb40c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/178333670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40a35f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 -- 172.21.15.38:0/178333670 >> 172.21.15.38:0/178333670 conn(0x7efcb40a5cc0 msgr2=0x7efcb40a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:11.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 -- 172.21.15.38:0/178333670 shutdown_connections 2023-06-23T18:52:11.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.686+0000 7efcbbb2a640 1 -- 172.21.15.38:0/178333670 wait complete. 2023-06-23T18:52:11.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 Processor -- start 2023-06-23T18:52:11.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- start start 2023-06-23T18:52:11.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb40a30c0 0x7efcb40ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40bee10 0x7efcb41518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40b92d0 con 0x7efcb40bea40 2023-06-23T18:52:11.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40a9f70 con 0x7efcb40a30c0 2023-06-23T18:52:11.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40b9e60 con 0x7efcb40bee10 2023-06-23T18:52:11.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34894/0 (socket says 172.21.15.38:34894) 2023-06-23T18:52:11.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 -- 172.21.15.38:0/3436184766 learned_addr learned my addr 172.21.15.38:0/3436184766 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-06-23T18:52:11.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcba0c7640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40bee10 0x7efcb41518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb98c6640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb40a30c0 0x7efcb40ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 -- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40bee10 msgr2=0x7efcb41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:11.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40bee10 0x7efcb41518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 -- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb40a30c0 msgr2=0x7efcb40ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:11.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb40a30c0 0x7efcb40ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:11.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 -- 172.21.15.38:0/3436184766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00094d0 con 0x7efcb40bea40 2023-06-23T18:52:11.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcb90c5640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efca400d800 tx=0x7efca400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:11.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40096a0 con 0x7efcb40bea40 2023-06-23T18:52:11.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efca4009800 con 0x7efcb40bea40 2023-06-23T18:52:11.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4009b90 con 0x7efcb40bea40 2023-06-23T18:52:11.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb4151df0 con 0x7efcb40bea40 2023-06-23T18:52:11.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb414de90 con 0x7efcb40bea40 2023-06-23T18:52:11.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.690+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40b9ff0 con 0x7efcb40bea40 2023-06-23T18:52:11.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.694+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efca4009cf0 con 0x7efcb40bea40 2023-06-23T18:52:11.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.694+0000 7efcaa7fc640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 0x7efc98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:52:11.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.694+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6047+0+0 (secure 0 0 0) 0x7efca4084b40 con 0x7efcb40bea40 2023-06-23T18:52:11.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.694+0000 7efcb98c6640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 0x7efc98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:52:11.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.694+0000 7efcb98c6640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 0x7efc98068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ad000 tx=0x7efcb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:52:11.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.698+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efca4051f20 con 0x7efcb40bea40 2023-06-23T18:52:11.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:11.850+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcb404d790 con 0x7efcb40bea40 2023-06-23T18:52:12.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.522+0000 7efcaa7fc640 1 -- 172.21.15.38:0/3436184766 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7efca4055540 con 0x7efcb40bea40 2023-06-23T18:52:12.530 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data_ec' removed 2023-06-23T18:52:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 msgr2=0x7efc98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 0x7efc98068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ad000 tx=0x7efcb0008040 comp rx=0 tx=0).stop 2023-06-23T18:52:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 msgr2=0x7efcb40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:52:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efca400d800 tx=0x7efca400dcc0 comp rx=0 tx=0).stop 2023-06-23T18:52:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 shutdown_connections 2023-06-23T18:52:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:6832/3176118993,v1:172.21.15.81:6833/3176118993] conn(0x7efc98066280 0x7efc98068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcb40bee10 0x7efcb41518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcb40bea40 0x7efcb40b8d90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 --2- 172.21.15.38:0/3436184766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb40a30c0 0x7efcb40ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:52:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 >> 172.21.15.38:0/3436184766 conn(0x7efcb40a5cc0 msgr2=0x7efcb414a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:52:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 shutdown_connections 2023-06-23T18:52:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-06-23T18:52:12.526+0000 7efcbbb2a640 1 -- 172.21.15.38:0/3436184766 wait complete. 2023-06-23T18:52:12.561 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-23T18:52:12.561 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-23T18:52:12.562 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:12.576 INFO:tasks.ceph.mds.a:Stopped 2023-06-23T18:52:12.577 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-23T18:52:12.577 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:12.594 INFO:tasks.ceph.mds.b:Stopped 2023-06-23T18:52:12.594 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-23T18:52:12.595 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-23T18:52:12.595 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:18.699 INFO:tasks.ceph.osd.0:Stopped 2023-06-23T18:52:18.699 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-23T18:52:18.700 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:18.778 INFO:tasks.ceph.osd.1:Stopped 2023-06-23T18:52:18.779 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-23T18:52:18.779 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:19.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-06-23T18:52:23.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:23.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:23.940 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:23.942 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:23.944 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:24.881 INFO:tasks.ceph.osd.2:Stopped 2023-06-23T18:52:24.883 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-23T18:52:24.883 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:24.947 INFO:tasks.ceph.osd.3:Stopped 2023-06-23T18:52:24.948 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-23T18:52:24.948 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:25.022 INFO:tasks.ceph.osd.4:Stopped 2023-06-23T18:52:25.023 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-23T18:52:25.023 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:25.100 INFO:tasks.ceph.osd.5:Stopped 2023-06-23T18:52:25.101 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-23T18:52:25.101 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:25.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-06-23T18:52:25.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-06-23T18:52:25.180 INFO:tasks.ceph.osd.6:Stopped 2023-06-23T18:52:25.181 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-23T18:52:25.181 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:30.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-06-23T18:52:30.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-06-23T18:52:31.284 INFO:tasks.ceph.osd.7:Stopped 2023-06-23T18:52:31.285 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-23T18:52:31.285 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-23T18:52:31.286 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:31.313 INFO:tasks.ceph.mgr.y:Stopped 2023-06-23T18:52:31.315 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-23T18:52:31.315 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:31.344 INFO:tasks.ceph.mgr.x:Stopped 2023-06-23T18:52:31.345 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-23T18:52:31.345 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-23T18:52:31.346 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:31.377 INFO:tasks.ceph.mon.a:Stopped 2023-06-23T18:52:31.378 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-23T18:52:31.378 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:31.398 INFO:tasks.ceph.mon.b:Stopped 2023-06-23T18:52:31.399 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-23T18:52:31.399 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:52:31.458 INFO:tasks.ceph.mon.c:Stopped 2023-06-23T18:52:31.459 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-23T18:52:31.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-06-23T18:52:31.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:52:31.477 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-23T18:52:31.876 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:52:31.876 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-23T18:52:32.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:52:32.099 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-23T18:52:32.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:52:32.302 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-23T18:52:32.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:52:32.504 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-23T18:52:32.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:52:32.969 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-23T18:52:33.185 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:52:33.186 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-23T18:52:33.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:52:33.396 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-23T18:52:33.601 INFO:tasks.ceph:Archiving mon data... 2023-06-23T18:52:33.603 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/data/mon.a.tgz 2023-06-23T18:52:33.603 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-06-23T18:52:33.609 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.79uvId3vVW 2023-06-23T18:52:33.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.79uvId3vVW 2023-06-23T18:52:33.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.79uvId3vVW 2023-06-23T18:52:33.797 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.79uvId3vVW is 302KB 2023-06-23T18:52:33.860 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.79uvId3vVW 2023-06-23T18:52:33.865 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/data/mon.b.tgz 2023-06-23T18:52:33.866 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-06-23T18:52:33.872 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.J6WHgBz4wV 2023-06-23T18:52:33.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.J6WHgBz4wV 2023-06-23T18:52:34.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.J6WHgBz4wV 2023-06-23T18:52:34.074 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.J6WHgBz4wV is 397KB 2023-06-23T18:52:34.136 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.J6WHgBz4wV 2023-06-23T18:52:34.141 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/data/mon.c.tgz 2023-06-23T18:52:34.142 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-06-23T18:52:34.186 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.PZ5s723ofk 2023-06-23T18:52:34.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PZ5s723ofk 2023-06-23T18:52:34.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.PZ5s723ofk 2023-06-23T18:52:34.394 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.PZ5s723ofk is 397KB 2023-06-23T18:52:34.413 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.PZ5s723ofk 2023-06-23T18:52:34.418 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-23T18:52:34.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T18:52:34.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T18:52:34.463 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T18:52:34.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T18:52:34.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T18:52:34.484 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-23T18:52:34.484 DEBUG:teuthology.orchestra.run.smithi038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T18:52:34.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T18:52:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T18:52:34.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T18:52:34.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T18:52:34.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T18:52:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T18:52:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T18:52:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T18:52:34.632 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T18:52:34.637 INFO:tasks.ceph:Archiving crash dumps... 2023-06-23T18:52:34.640 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi038/crash 2023-06-23T18:52:34.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T18:52:34.659 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi081/crash 2023-06-23T18:52:34.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T18:52:34.675 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi118/crash 2023-06-23T18:52:34.676 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T18:52:34.691 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi164/crash 2023-06-23T18:52:34.692 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T18:52:34.706 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi192/crash 2023-06-23T18:52:34.707 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T18:52:34.719 INFO:tasks.ceph:Shutting down logrotate 2023-06-23T18:52:34.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.739 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.753 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.861 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:34.872 INFO:tasks.ceph:Compressing logs... 2023-06-23T18:52:34.873 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-23T18:52:34.875 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-23T18:52:34.879 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-23T18:52:34.891 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-23T18:52:34.893 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2023-06-23T18:52:34.895 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32576.log 2023-06-23T18:52:34.895 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2023-06-23T18:52:34.895 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.tmp-client.admin.32576.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2023-06-23T18:52:34.896 INFO:teuthology.orchestra.run.smithi038.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32576.log.gz 2023-06-23T18:52:34.896 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-06-23T18:52:34.898 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2023-06-23T18:52:34.898 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mgr.y.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2023-06-23T18:52:34.898 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2023-06-23T18:52:34.898 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42623.log 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44265.log 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2023-06-23T18:52:34.899 INFO:teuthology.orchestra.run.smithi038.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42623.log.gz 2023-06-23T18:52:34.900 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2023-06-23T18:52:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-06-23T18:52:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-06-23T18:52:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37694.log 2023-06-23T18:52:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37622.log 2023-06-23T18:52:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37694.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-06-23T18:52:34.909 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37694.log.gz 2023-06-23T18:52:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37574.log 2023-06-23T18:52:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37622.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-06-23T18:52:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37574.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37622.log.gz 2023-06-23T18:52:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-06-23T18:52:34.910 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37574.log.gz 2023-06-23T18:52:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-06-23T18:52:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-06-23T18:52:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37646.log 2023-06-23T18:52:34.911 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2023-06-23T18:52:34.911 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37646.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37646.log.gz 2023-06-23T18:52:34.911 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-06-23T18:52:34.911 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37670.log 2023-06-23T18:52:34.911 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37598.log 2023-06-23T18:52:34.912 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-06-23T18:52:34.912 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37718.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-06-23T18:52:34.912 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2023-06-23T18:52:34.912 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37670.log: /var/log/ceph/ceph-client.admin.37598.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-06-23T18:52:34.914 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-23T18:52:34.917 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32912.log 2023-06-23T18:52:34.917 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32743.log 2023-06-23T18:52:34.918 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.32912.log: /var/log/ceph/ceph-client.admin.32743.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.32912.log.gz 2023-06-23T18:52:34.918 INFO:teuthology.orchestra.run.smithi118.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.32743.log.gz 2023-06-23T18:52:34.918 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-06-23T18:52:34.918 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m0.018s 2023-06-23T18:52:34.919 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m0.011s 2023-06-23T18:52:34.919 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m0.012s 2023-06-23T18:52:34.919 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37598.log.gz/var/log/ceph/ceph-mds.b.log: 2023-06-23T18:52:34.919 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37670.log.gz 2023-06-23T18:52:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-06-23T18:52:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.b.log: gzip 92.3% -5 -- replaced with /var/log/ceph/ceph-mds.b.log.gz --verbose 2023-06-23T18:52:34.920 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.37550.log 2023-06-23T18:52:34.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37550.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37550.log.gz 2023-06-23T18:52:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32754.log 2023-06-23T18:52:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.32754.log: 91.3% -- replaced with /var/log/ceph/ceph-client.1.32754.log.gz 2023-06-23T18:52:34.935 INFO:teuthology.orchestra.run.smithi164.stderr: 2023-06-23T18:52:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m0.023s 2023-06-23T18:52:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m0.018s 2023-06-23T18:52:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.004s 2023-06-23T18:52:34.939 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2023-06-23T18:52:34.940 INFO:teuthology.orchestra.run.smithi038.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44265.log.gz 2023-06-23T18:52:34.940 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2023-06-23T18:52:34.940 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2023-06-23T18:52:34.940 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2023-06-23T18:52:34.940 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42104.log: /var/log/ceph/ceph-client.admin.45227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2023-06-23T18:52:34.941 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2023-06-23T18:52:34.941 INFO:teuthology.orchestra.run.smithi038.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2023-06-23T18:52:34.941 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-06-23T18:52:34.941 INFO:teuthology.orchestra.run.smithi038.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2023-06-23T18:52:34.942 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45311.log 2023-06-23T18:52:34.942 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-06-23T18:52:34.942 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2023-06-23T18:52:34.942 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2023-06-23T18:52:34.942 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2023-06-23T18:52:34.943 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45311.log.gz 2023-06-23T18:52:34.943 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41392.log 2023-06-23T18:52:34.943 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41053.log 2023-06-23T18:52:34.943 INFO:teuthology.orchestra.run.smithi038.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2023-06-23T18:52:34.943 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44031.log: /var/log/ceph/ceph-client.admin.41392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2023-06-23T18:52:34.944 INFO:teuthology.orchestra.run.smithi038.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2023-06-23T18:52:34.944 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41392.log.gz 2023-06-23T18:52:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2023-06-23T18:52:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45368.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41053.log.gz 2023-06-23T18:52:34.944 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2023-06-23T18:52:34.945 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2023-06-23T18:52:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2023-06-23T18:52:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2023-06-23T18:52:34.946 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41870.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2023-06-23T18:52:34.946 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2023-06-23T18:52:34.946 INFO:teuthology.orchestra.run.smithi038.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2023-06-23T18:52:34.946 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2023-06-23T18:52:34.947 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41206.log 2023-06-23T18:52:34.947 INFO:teuthology.orchestra.run.smithi038.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2023-06-23T18:52:34.947 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2023-06-23T18:52:34.948 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42417.log: /var/log/ceph/ceph-client.admin.41206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2023-06-23T18:52:34.948 INFO:teuthology.orchestra.run.smithi038.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2023-06-23T18:52:34.948 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41206.log.gz 2023-06-23T18:52:34.948 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2023-06-23T18:52:34.949 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz --verbose 2023-06-23T18:52:34.949 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.admin.42834.log 2023-06-23T18:52:34.949 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43328.log: /var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2023-06-23T18:52:34.949 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2023-06-23T18:52:34.949 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2023-06-23T18:52:34.950 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2023-06-23T18:52:34.950 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.42210.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43717.log 2023-06-23T18:52:34.950 INFO:teuthology.orchestra.run.smithi038.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2023-06-23T18:52:34.950 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43925.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2023-06-23T18:52:34.950 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2023-06-23T18:52:34.951 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2023-06-23T18:52:34.951 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2023-06-23T18:52:34.951 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2023-06-23T18:52:34.951 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44941.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43717.log.gz 2023-06-23T18:52:34.952 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2023-06-23T18:52:34.952 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gzgzip 2023-06-23T18:52:34.952 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2023-06-23T18:52:34.952 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44915.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-06-23T18:52:34.953 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43198.log: /var/log/ceph/ceph-client.admin.37452.log 2023-06-23T18:52:34.953 INFO:teuthology.orchestra.run.smithi038.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2023-06-23T18:52:34.953 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2023-06-23T18:52:34.953 INFO:teuthology.orchestra.run.smithi038.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2023-06-23T18:52:34.954 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.37452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45097.log 2023-06-23T18:52:34.954 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2023-06-23T18:52:34.954 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2023-06-23T18:52:34.954 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2023-06-23T18:52:34.954 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2023-06-23T18:52:34.955 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2023-06-23T18:52:34.955 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42627.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45097.log.gz 2023-06-23T18:52:34.955 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44421.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2023-06-23T18:52:34.955 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2023-06-23T18:52:34.956 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41766.log 2023-06-23T18:52:34.956 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45071.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2023-06-23T18:52:34.956 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43665.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-06-23T18:52:34.956 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2023-06-23T18:52:34.956 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45337.log 2023-06-23T18:52:34.957 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41766.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2023-06-23T18:52:34.957 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.a.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41766.log.gz -- 2023-06-23T18:52:34.957 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/ceph-client.admin.42026.log 2023-06-23T18:52:34.957 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2023-06-23T18:52:34.958 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45337.log: /var/log/ceph/ceph-client.admin.42026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2023-06-23T18:52:34.958 INFO:teuthology.orchestra.run.smithi038.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45337.log.gz 2023-06-23T18:52:34.958 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43276.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2023-06-23T18:52:34.959 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41508.log 2023-06-23T18:52:34.959 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42000.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2023-06-23T18:52:34.959 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2023-06-23T18:52:34.959 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2023-06-23T18:52:34.959 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2023-06-23T18:52:34.960 INFO:teuthology.orchestra.run.smithi038.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41508.log.gz 2023-06-23T18:52:34.960 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2023-06-23T18:52:34.960 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44655.log: /var/log/ceph/ceph-client.admin.45281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2023-06-23T18:52:34.960 INFO:teuthology.orchestra.run.smithi038.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2023-06-23T18:52:34.961 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41364.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2023-06-23T18:52:34.961 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2023-06-23T18:52:34.961 INFO:teuthology.orchestra.run.smithi038.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2023-06-23T18:52:34.961 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44343.log 2023-06-23T18:52:34.961 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45496.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2023-06-23T18:52:34.962 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41310.log 2023-06-23T18:52:34.962 INFO:teuthology.orchestra.run.smithi038.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2023-06-23T18:52:34.962 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log/var/log/ceph/ceph-client.admin.44343.log: 2023-06-23T18:52:34.962 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40972.log 2023-06-23T18:52:34.962 INFO:teuthology.orchestra.run.smithi038.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz 2023-06-23T18:52:34.963 INFO:teuthology.orchestra.run.smithi038.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41310.log.gz 2023-06-23T18:52:34.963 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43120.log 2023-06-23T18:52:34.963 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2023-06-23T18:52:34.963 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2023-06-23T18:52:34.964 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40972.log.gz 2023-06-23T18:52:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2023-06-23T18:52:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43120.log: /var/log/ceph/ceph-client.admin.43250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2023-06-23T18:52:34.964 INFO:teuthology.orchestra.run.smithi038.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43120.log.gz 2023-06-23T18:52:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42288.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2023-06-23T18:52:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2023-06-23T18:52:34.965 INFO:teuthology.orchestra.run.smithi038.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2023-06-23T18:52:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42613.log 2023-06-23T18:52:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44629.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2023-06-23T18:52:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2023-06-23T18:52:34.966 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2023-06-23T18:52:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2023-06-23T18:52:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42613.log: /var/log/ceph/ceph-client.admin.42236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2023-06-23T18:52:34.967 INFO:teuthology.orchestra.run.smithi038.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42613.log.gz 2023-06-23T18:52:34.967 INFO:teuthology.orchestra.run.smithi038.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2023-06-23T18:52:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2023-06-23T18:52:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37342.log 2023-06-23T18:52:34.968 INFO:teuthology.orchestra.run.smithi038.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2023-06-23T18:52:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2023-06-23T18:52:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45019.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2023-06-23T18:52:34.969 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.37342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-06-23T18:52:34.969 INFO:teuthology.orchestra.run.smithi038.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2023-06-23T18:52:34.969 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2023-06-23T18:52:34.969 INFO:teuthology.orchestra.run.smithi038.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2023-06-23T18:52:34.970 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.37342.log.gz 2023-06-23T18:52:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2023-06-23T18:52:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2023-06-23T18:52:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43899.log: /var/log/ceph/ceph-client.admin.41454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 2023-06-23T18:52:34.970 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1%/var/log/ceph/ceph-client.admin.43691.log: -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz 2023-06-23T18:52:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 2023-06-23T18:52:34.971 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2023-06-23T18:52:34.971 INFO:teuthology.orchestra.run.smithi038.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2023-06-23T18:52:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42411.log 2023-06-23T18:52:34.972 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44213.log: /var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44317.log 2023-06-23T18:52:34.972 INFO:teuthology.orchestra.run.smithi038.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2023-06-23T18:52:34.972 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2023-06-23T18:52:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42411.log: 2023-06-23T18:52:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2023-06-23T18:52:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44317.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42411.log.gz 2023-06-23T18:52:34.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2023-06-23T18:52:34.973 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44317.log.gz 2023-06-23T18:52:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44187.log 2023-06-23T18:52:34.974 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2023-06-23T18:52:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2023-06-23T18:52:34.974 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44733.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2023-06-23T18:52:34.975 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41586.log 2023-06-23T18:52:34.975 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44187.log.gz 2023-06-23T18:52:34.975 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:34.975 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2023-06-23T18:52:34.975 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2023-06-23T18:52:34.976 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2023-06-23T18:52:34.976 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41586.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-06-23T18:52:34.976 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43639.log: /var/log/ceph/ceph-client.admin.44837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2023-06-23T18:52:34.977 INFO:teuthology.orchestra.run.smithi038.stderr: 88.4% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41586.log.gz 2023-06-23T18:52:34.977 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2023-06-23T18:52:34.977 INFO:teuthology.orchestra.run.smithi038.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2023-06-23T18:52:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45522.log 2023-06-23T18:52:34.978 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2023-06-23T18:52:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45567.log 2023-06-23T18:52:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2023-06-23T18:52:34.979 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41108.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45522.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2023-06-23T18:52:34.980 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41154.log 2023-06-23T18:52:34.980 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2023-06-23T18:52:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45567.log: /var/log/ceph/ceph-client.admin.41154.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42835.log 2023-06-23T18:52:34.982 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45567.log.gz 2023-06-23T18:52:34.982 INFO:teuthology.orchestra.run.smithi038.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41154.log.gz 2023-06-23T18:52:34.982 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43172.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2023-06-23T18:52:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43458.log 2023-06-23T18:52:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2023-06-23T18:52:34.984 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9%/var/log/ceph/ceph-client.admin.43458.log: -- replaced with /var/log/ceph/ceph-client.admin.42835.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43354.log 2023-06-23T18:52:34.984 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:34.984 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43458.log.gz 2023-06-23T18:52:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42052.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2023-06-23T18:52:34.986 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-06-23T18:52:34.988 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.32772.log 2023-06-23T18:52:34.988 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.2.32772.log: 91.6% -- replaced with /var/log/ceph/ceph-client.2.32772.log.gz 2023-06-23T18:52:34.988 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-06-23T18:52:34.989 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m0.022s 2023-06-23T18:52:34.989 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m0.016s 2023-06-23T18:52:34.989 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.004s 2023-06-23T18:52:35.002 INFO:teuthology.orchestra.run.smithi081.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-06-23T18:52:35.010 INFO:teuthology.orchestra.run.smithi081.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-06-23T18:52:35.023 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2023-06-23T18:52:35.024 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2023-06-23T18:52:35.024 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43873.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43354.log.gz 2023-06-23T18:52:35.024 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2023-06-23T18:52:35.024 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2023-06-23T18:52:35.024 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz/var/log/ceph/ceph-client.admin.44811.log: 2023-06-23T18:52:35.025 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44473.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2023-06-23T18:52:35.025 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2023-06-23T18:52:35.025 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43094.log 2023-06-23T18:52:35.025 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44577.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-06-23T18:52:35.026 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7%/var/log/ceph/ceph-client.admin.43094.log: -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2023-06-23T18:52:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2023-06-23T18:52:35.026 INFO:teuthology.orchestra.run.smithi038.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43094.log.gz 2023-06-23T18:52:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-06-23T18:52:35.026 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45619.log 2023-06-23T18:52:35.027 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2023-06-23T18:52:35.027 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45619.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2023-06-23T18:52:35.027 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45253.log 2023-06-23T18:52:35.027 INFO:teuthology.orchestra.run.smithi038.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45619.log.gz 2023-06-23T18:52:35.027 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43432.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2023-06-23T18:52:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42811.log 2023-06-23T18:52:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2023-06-23T18:52:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42811.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45253.log.gz 2023-06-23T18:52:35.028 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2023-06-23T18:52:35.029 INFO:teuthology.orchestra.run.smithi038.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2023-06-23T18:52:35.029 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42811.log.gz 2023-06-23T18:52:35.029 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41482.log: /var/log/ceph/ceph-client.admin.42812.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 88.3% 2023-06-23T18:52:35.029 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.37562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45149.log 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41079.log 2023-06-23T18:52:35.030 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz 2023-06-23T18:52:35.031 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42621.log: /var/log/ceph/ceph-client.admin.45149.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2023-06-23T18:52:35.031 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45149.log.gz 2023-06-23T18:52:35.031 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2023-06-23T18:52:35.031 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2023-06-23T18:52:35.031 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45045.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2023-06-23T18:52:35.032 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41079.log.gz 2023-06-23T18:52:35.032 INFO:teuthology.orchestra.run.smithi038.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2023-06-23T18:52:35.032 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42413.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2023-06-23T18:52:35.032 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43380.log 2023-06-23T18:52:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41028.log 2023-06-23T18:52:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2023-06-23T18:52:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2023-06-23T18:52:35.033 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2023-06-23T18:52:35.033 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43380.log.gz 2023-06-23T18:52:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41028.log: /var/log/ceph/ceph-client.admin.42628.log: 89.0% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41028.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2023-06-23T18:52:35.034 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:35.034 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2023-06-23T18:52:35.035 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2023-06-23T18:52:35.035 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44005.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2023-06-23T18:52:35.036 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2023-06-23T18:52:35.036 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2023-06-23T18:52:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42340.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2023-06-23T18:52:35.036 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2023-06-23T18:52:35.037 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43484.log 2023-06-23T18:52:35.037 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44499.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2023-06-23T18:52:35.037 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2023-06-23T18:52:35.037 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2023-06-23T18:52:35.037 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2023-06-23T18:52:35.038 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43484.log: /var/log/ceph/ceph-client.admin.42617.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43484.log.gz 2023-06-23T18:52:35.038 INFO:teuthology.orchestra.run.smithi038.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2023-06-23T18:52:35.038 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41232.log 2023-06-23T18:52:35.038 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2023-06-23T18:52:35.038 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41232.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2023-06-23T18:52:35.039 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2023-06-23T18:52:35.039 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41232.log.gz 2023-06-23T18:52:35.039 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41922.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2023-06-23T18:52:35.039 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2023-06-23T18:52:35.039 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2023-06-23T18:52:35.040 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43613.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2023-06-23T18:52:35.040 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2023-06-23T18:52:35.040 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2023-06-23T18:52:35.040 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz/var/log/ceph/ceph-client.admin.44967.log: 2023-06-23T18:52:35.040 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44135.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2023-06-23T18:52:35.041 INFO:teuthology.orchestra.run.smithi038.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2023-06-23T18:52:35.041 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-06-23T18:52:35.041 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2023-06-23T18:52:35.041 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.audit.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2023-06-23T18:52:35.041 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-06-23T18:52:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2023-06-23T18:52:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43016.log: /var/log/ceph/ceph-mds.a.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2023-06-23T18:52:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2023-06-23T18:52:35.042 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-06-23T18:52:35.042 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44707.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2023-06-23T18:52:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2023-06-23T18:52:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42420.log 2023-06-23T18:52:35.043 INFO:teuthology.orchestra.run.smithi038.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz/var/log/ceph/ceph-client.admin.43587.log: 2023-06-23T18:52:35.043 INFO:teuthology.orchestra.run.smithi038.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2023-06-23T18:52:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2023-06-23T18:52:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2023-06-23T18:52:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42420.log: /var/log/ceph/ceph-client.admin.42262.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42420.log.gz 2023-06-23T18:52:35.044 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2023-06-23T18:52:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2023-06-23T18:52:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45175.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2023-06-23T18:52:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41284.log 2023-06-23T18:52:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41560.log 2023-06-23T18:52:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45201.log: /var/log/ceph/ceph-client.admin.41284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2023-06-23T18:52:35.045 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41284.log.gz 2023-06-23T18:52:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2023-06-23T18:52:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2023-06-23T18:52:35.047 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41560.log: /var/log/ceph/ceph-client.admin.45418.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41560.log.gz 2023-06-23T18:52:35.047 INFO:teuthology.orchestra.run.smithi038.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2023-06-23T18:52:35.047 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44369.log 2023-06-23T18:52:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41714.log 2023-06-23T18:52:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43769.log: /var/log/ceph/ceph-client.admin.44369.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2023-06-23T18:52:35.049 INFO:teuthology.orchestra.run.smithi038.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44369.log.gz 2023-06-23T18:52:35.049 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2023-06-23T18:52:35.049 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41714.log.gz 2023-06-23T18:52:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41974.log 2023-06-23T18:52:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2023-06-23T18:52:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44993.log: /var/log/ceph/ceph-client.admin.41974.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2023-06-23T18:52:35.051 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41974.log.gz 2023-06-23T18:52:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41844.log 2023-06-23T18:52:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43977.log 2023-06-23T18:52:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41818.log: /var/log/ceph/ceph-client.admin.41844.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2023-06-23T18:52:35.053 INFO:teuthology.orchestra.run.smithi038.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41844.log.gz 2023-06-23T18:52:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2023-06-23T18:52:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2023-06-23T18:52:35.054 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43977.log: /var/log/ceph/ceph-client.admin.44889.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43977.log.gz 2023-06-23T18:52:35.054 INFO:teuthology.orchestra.run.smithi038.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2023-06-23T18:52:35.054 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2023-06-23T18:52:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43042.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2023-06-23T18:52:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2023-06-23T18:52:35.056 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2023-06-23T18:52:35.056 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44109.log: /var/log/ceph/ceph-client.admin.41638.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2023-06-23T18:52:35.056 INFO:teuthology.orchestra.run.smithi038.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2023-06-23T18:52:35.057 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:35.057 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43302.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2023-06-23T18:52:35.057 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42399.log 2023-06-23T18:52:35.058 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2023-06-23T18:52:35.058 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44395.log: /var/log/ceph/ceph-client.admin.42399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2023-06-23T18:52:35.059 INFO:teuthology.orchestra.run.smithi038.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2023-06-23T18:52:35.059 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42399.log.gz 2023-06-23T18:52:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45444.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2023-06-23T18:52:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2023-06-23T18:52:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41740.log 2023-06-23T18:52:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44239.log: /var/log/ceph/ceph-client.admin.44759.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2023-06-23T18:52:35.061 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2023-06-23T18:52:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2023-06-23T18:52:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44681.log 2023-06-23T18:52:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41740.log: /var/log/ceph/ceph-client.admin.43795.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41740.log.gz 2023-06-23T18:52:35.062 INFO:teuthology.orchestra.run.smithi038.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2023-06-23T18:52:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41534.log 2023-06-23T18:52:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42182.log 2023-06-23T18:52:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.44681.log: /var/log/ceph/ceph-client.admin.41534.log: 87.8% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44681.log.gz 2023-06-23T18:52:35.064 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41534.log.gz 2023-06-23T18:52:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2023-06-23T18:52:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41258.log 2023-06-23T18:52:35.065 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42182.log: /var/log/ceph/ceph-client.admin.42130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42182.log.gz 2023-06-23T18:52:35.065 INFO:teuthology.orchestra.run.smithi038.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2023-06-23T18:52:35.066 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41612.log 2023-06-23T18:52:35.066 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2023-06-23T18:52:35.066 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41258.log: /var/log/ceph/ceph-client.admin.41612.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41258.log.gz 2023-06-23T18:52:35.067 INFO:teuthology.orchestra.run.smithi038.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41612.log.gz 2023-06-23T18:52:35.067 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41664.log 2023-06-23T18:52:35.068 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42314.log 2023-06-23T18:52:35.068 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45392.log: /var/log/ceph/ceph-client.admin.41664.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2023-06-23T18:52:35.069 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41336.log 2023-06-23T18:52:35.069 INFO:teuthology.orchestra.run.smithi038.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41664.log.gz 2023-06-23T18:52:35.069 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42314.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42314.log.gz 2023-06-23T18:52:35.070 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2023-06-23T18:52:35.070 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2023-06-23T18:52:35.071 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41336.log: /var/log/ceph/ceph-client.admin.44863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41336.log.gz 2023-06-23T18:52:35.071 INFO:teuthology.orchestra.run.smithi038.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2023-06-23T18:52:35.072 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2023-06-23T18:52:35.072 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2023-06-23T18:52:35.073 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42826.log: /var/log/ceph/ceph-client.admin.44083.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gz 2023-06-23T18:52:35.073 INFO:teuthology.orchestra.run.smithi038.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2023-06-23T18:52:35.073 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42836.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2023-06-23T18:52:35.074 INFO:teuthology.orchestra.run.smithi038.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-06-23T18:52:35.138 INFO:teuthology.orchestra.run.smithi038.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-06-23T18:52:35.511 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-06-23T18:52:35.540 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-06-23T18:52:35.569 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-06-23T18:52:35.570 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-06-23T18:52:35.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-06-23T18:52:35.611 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-06-23T18:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-06-23T18:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m0.732s 2023-06-23T18:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m2.820s 2023-06-23T18:52:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.090s 2023-06-23T18:52:35.628 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-06-23T18:52:35.642 INFO:teuthology.orchestra.run.smithi038.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-06-23T18:52:35.745 INFO:teuthology.orchestra.run.smithi038.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-06-23T18:52:35.746 INFO:teuthology.orchestra.run.smithi038.stderr: 2023-06-23T18:52:35.746 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m0.869s 2023-06-23T18:52:35.746 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m3.282s 2023-06-23T18:52:35.747 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m0.158s 2023-06-23T18:52:35.748 INFO:tasks.ceph:Archiving logs... 2023-06-23T18:52:35.748 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi038/log 2023-06-23T18:52:35.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T18:52:36.208 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi081/log 2023-06-23T18:52:36.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T18:52:36.514 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi118/log 2023-06-23T18:52:36.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T18:52:36.532 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi164/log 2023-06-23T18:52:36.533 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T18:52:36.549 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi192/log 2023-06-23T18:52:36.550 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T18:52:36.566 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-23T18:52:36.577 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-23T18:52:36.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T18:52:36.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T18:52:36.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T18:52:36.586 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T18:52:36.596 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T18:52:36.775 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-23T18:52:36.789 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-23T18:52:36.790 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:52:36.794 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:52:36.797 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:52:36.800 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:52:36.803 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:52:36.809 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:52:36.809 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-06-23T18:52:36.809 INFO:teuthology.orchestra.run.smithi081.stdout:*hv01.front.sepi 44.4.53.2 2 u 37 64 177 0.142 -1.075 3.431 2023-06-23T18:52:36.810 INFO:teuthology.orchestra.run.smithi081.stdout:+hv02.front.sepi 63.231.80.2 3 u 36 64 177 0.111 +3.451 3.441 2023-06-23T18:52:36.812 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 177 0.140 -7.000 3.236 2023-06-23T18:52:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:52:36.813 INFO:teuthology.orchestra.run.smithi038.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:52:36.814 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================== 2023-06-23T18:52:36.814 INFO:teuthology.orchestra.run.smithi038.stdout:*hv01.front.sepi 44.4.53.2 2 u 42 64 177 0.114 -3.649 3.287 2023-06-23T18:52:36.814 INFO:teuthology.orchestra.run.smithi038.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 177 0.106 +1.395 3.178 2023-06-23T18:52:36.814 INFO:teuthology.orchestra.run.smithi038.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 177 0.075 -11.177 4.108 2023-06-23T18:52:36.815 INFO:teuthology.orchestra.run.smithi038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:52:36.817 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:52:36.817 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2023-06-23T18:52:36.818 INFO:teuthology.orchestra.run.smithi164.stdout:*hv01.front.sepi 44.4.53.2 2 u 40 64 177 0.117 -0.200 1.637 2023-06-23T18:52:36.818 INFO:teuthology.orchestra.run.smithi164.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 177 0.137 +4.361 1.649 2023-06-23T18:52:36.818 INFO:teuthology.orchestra.run.smithi164.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 177 0.093 -4.675 2.872 2023-06-23T18:52:36.818 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:52:36.819 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:52:36.819 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2023-06-23T18:52:36.819 INFO:teuthology.orchestra.run.smithi118.stdout:+hv01.front.sepi 44.4.53.2 2 u 34 64 177 0.081 +5.428 5.258 2023-06-23T18:52:36.819 INFO:teuthology.orchestra.run.smithi118.stdout:*hv02.front.sepi 63.231.80.2 3 u 40 64 177 0.091 +9.124 4.489 2023-06-23T18:52:36.819 INFO:teuthology.orchestra.run.smithi118.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 177 0.098 -4.565 3.007 2023-06-23T18:52:36.820 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:52:36.822 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T18:52:36.822 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-06-23T18:52:36.822 INFO:teuthology.orchestra.run.smithi192.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 177 0.097 +0.810 1.940 2023-06-23T18:52:36.823 INFO:teuthology.orchestra.run.smithi192.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 177 0.076 +3.894 1.017 2023-06-23T18:52:36.823 INFO:teuthology.orchestra.run.smithi192.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 177 0.135 -5.056 2.089 2023-06-23T18:52:36.823 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-23T18:52:36.824 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-23T18:52:36.834 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-23T18:52:36.834 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-23T18:52:36.845 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-23T18:52:36.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-23T18:52:36.864 INFO:teuthology.task.internal:Duration was 906.558966 seconds 2023-06-23T18:52:36.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-23T18:52:36.875 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-23T18:52:36.876 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T18:52:36.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T18:52:36.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T18:52:36.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T18:52:36.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T18:52:36.966 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-23T18:52:36.967 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2023-06-23T18:52:36.967 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T18:52:36.979 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-06-23T18:52:36.979 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T18:52:36.989 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-06-23T18:52:36.990 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T18:52:36.999 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2023-06-23T18:52:37.000 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T18:52:37.011 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T18:52:37.011 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T18:52:37.021 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-23T18:52:37.022 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T18:52:37.024 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T18:52:37.035 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T18:52:37.042 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T18:52:37.055 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T18:52:37.087 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-23T18:52:37.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T18:52:37.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T18:52:37.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T18:52:37.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T18:52:37.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T18:52:37.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-23T18:52:37.199 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-23T18:52:37.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T18:52:37.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T18:52:37.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T18:52:37.238 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T18:52:37.252 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T18:52:37.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-23T18:52:37.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.282 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.288 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2023-06-23T18:52:37.291 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-06-23T18:52:37.291 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-06-23T18:52:37.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.305 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2023-06-23T18:52:37.317 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-06-23T18:52:37.389 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.395 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.438 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.443 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.449 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T18:52:37.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-23T18:52:37.469 INFO:teuthology.task.internal:Transferring archived files... 2023-06-23T18:52:37.471 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi038 2023-06-23T18:52:37.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T18:52:37.493 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi081 2023-06-23T18:52:37.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T18:52:37.519 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi118 2023-06-23T18:52:37.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T18:52:37.539 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi164 2023-06-23T18:52:37.540 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T18:52:37.565 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894/remote/smithi192 2023-06-23T18:52:37.566 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T18:52:37.584 INFO:teuthology.task.internal:Removing archive directory... 2023-06-23T18:52:37.585 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T18:52:37.588 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T18:52:37.590 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T18:52:37.593 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T18:52:37.608 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T18:52:37.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-23T18:52:37.645 INFO:teuthology.task.internal:Not uploading archives. 2023-06-23T18:52:37.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-23T18:52:37.656 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-23T18:52:37.657 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T18:52:37.659 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T18:52:37.662 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T18:52:37.664 INFO:teuthology.orchestra.run.smithi038.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 18:52 /home/ubuntu/cephtest 2023-06-23T18:52:37.665 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T18:52:37.666 INFO:teuthology.orchestra.run.smithi081.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 18:52 /home/ubuntu/cephtest 2023-06-23T18:52:37.667 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T18:52:37.668 INFO:teuthology.orchestra.run.smithi118.stdout: 655471 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 23 18:52 /home/ubuntu/cephtest 2023-06-23T18:52:37.669 INFO:teuthology.orchestra.run.smithi118.stdout: 673428 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 23 18:50 /home/ubuntu/cephtest/mdtest-1.9.3 2023-06-23T18:52:37.669 INFO:teuthology.orchestra.run.smithi118.stdout: 673431 8 -rwx------ 1 ubuntu ubuntu 6036 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/README 2023-06-23T18:52:37.669 INFO:teuthology.orchestra.run.smithi118.stdout: 673430 4 -rwx------ 1 ubuntu ubuntu 1859 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/Makefile 2023-06-23T18:52:37.669 INFO:teuthology.orchestra.run.smithi118.stdout: 673429 20 -rwx------ 1 ubuntu ubuntu 16962 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/COPYRIGHT 2023-06-23T18:52:37.670 INFO:teuthology.orchestra.run.smithi118.stdout: 676715 8 -rwx------ 1 ubuntu ubuntu 5282 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.1 2023-06-23T18:52:37.670 INFO:teuthology.orchestra.run.smithi118.stdout: 676717 4 drwx------ 2 ubuntu ubuntu 4096 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts 2023-06-23T18:52:37.670 INFO:teuthology.orchestra.run.smithi118.stdout: 676726 8 -rwx------ 1 ubuntu ubuntu 6264 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/tester.py 2023-06-23T18:52:37.670 INFO:teuthology.orchestra.run.smithi118.stdout: 676718 4 -rwx------ 1 ubuntu ubuntu 3462 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/env_to_db.tcsh 2023-06-23T18:52:37.670 INFO:teuthology.orchestra.run.smithi118.stdout: 676727 4 -rwx------ 1 ubuntu ubuntu 1255 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/WRAPPER_README 2023-06-23T18:52:37.671 INFO:teuthology.orchestra.run.smithi118.stdout: 676719 20 -rwx------ 1 ubuntu ubuntu 19576 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/mdtest_wrapper.py 2023-06-23T18:52:37.671 INFO:teuthology.orchestra.run.smithi118.stdout: 676720 4 -rwx------ 1 ubuntu ubuntu 1059 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/paramCatch.py 2023-06-23T18:52:37.671 INFO:teuthology.orchestra.run.smithi118.stdout: 676714 8 -rwx------ 1 ubuntu ubuntu 7123 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/RELEASE_LOG 2023-06-23T18:52:37.671 INFO:teuthology.orchestra.run.smithi118.stdout: 676716 96 -rw-r--r-- 1 ubuntu ubuntu 95873 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.c 2023-06-23T18:52:37.672 INFO:teuthology.orchestra.run.smithi164.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 23 18:52 /home/ubuntu/cephtest 2023-06-23T18:52:37.672 INFO:teuthology.orchestra.run.smithi164.stdout: 673421 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 23 18:50 /home/ubuntu/cephtest/mdtest-1.9.3 2023-06-23T18:52:37.672 INFO:teuthology.orchestra.run.smithi164.stdout: 673424 8 -rwx------ 1 ubuntu ubuntu 6036 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/README 2023-06-23T18:52:37.672 INFO:teuthology.orchestra.run.smithi164.stdout: 673423 4 -rwx------ 1 ubuntu ubuntu 1859 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/Makefile 2023-06-23T18:52:37.673 INFO:teuthology.orchestra.run.smithi164.stdout: 673422 20 -rwx------ 1 ubuntu ubuntu 16962 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/COPYRIGHT 2023-06-23T18:52:37.673 INFO:teuthology.orchestra.run.smithi164.stdout: 676708 8 -rwx------ 1 ubuntu ubuntu 5282 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.1 2023-06-23T18:52:37.673 INFO:teuthology.orchestra.run.smithi164.stdout: 676710 4 drwx------ 2 ubuntu ubuntu 4096 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts 2023-06-23T18:52:37.673 INFO:teuthology.orchestra.run.smithi164.stdout: 676714 8 -rwx------ 1 ubuntu ubuntu 6264 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/tester.py 2023-06-23T18:52:37.673 INFO:teuthology.orchestra.run.smithi164.stdout: 676711 4 -rwx------ 1 ubuntu ubuntu 3462 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/env_to_db.tcsh 2023-06-23T18:52:37.674 INFO:teuthology.orchestra.run.smithi164.stdout: 676720 4 -rwx------ 1 ubuntu ubuntu 1255 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/WRAPPER_README 2023-06-23T18:52:37.674 INFO:teuthology.orchestra.run.smithi164.stdout: 676712 20 -rwx------ 1 ubuntu ubuntu 19576 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/mdtest_wrapper.py 2023-06-23T18:52:37.674 INFO:teuthology.orchestra.run.smithi164.stdout: 676713 4 -rwx------ 1 ubuntu ubuntu 1059 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/paramCatch.py 2023-06-23T18:52:37.674 INFO:teuthology.orchestra.run.smithi164.stdout: 673425 8 -rwx------ 1 ubuntu ubuntu 7123 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/RELEASE_LOG 2023-06-23T18:52:37.674 INFO:teuthology.orchestra.run.smithi164.stdout: 676709 96 -rw-r--r-- 1 ubuntu ubuntu 95873 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.c 2023-06-23T18:52:37.675 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-06-23T18:52:37.677 INFO:teuthology.orchestra.run.smithi164.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-06-23T18:52:37.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:52:37.678 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-06-23T18:52:37.685 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-23T18:52:37.696 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-23T18:52:37.715 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-06-23T18:52:37.716 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T18:52:37.723 INFO:teuthology.orchestra.run.smithi192.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 23 18:52 /home/ubuntu/cephtest 2023-06-23T18:52:37.724 INFO:teuthology.orchestra.run.smithi192.stdout: 788846 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 23 18:50 /home/ubuntu/cephtest/mdtest-1.9.3 2023-06-23T18:52:37.724 INFO:teuthology.orchestra.run.smithi192.stdout: 788849 8 -rwx------ 1 ubuntu ubuntu 6036 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/README 2023-06-23T18:52:37.724 INFO:teuthology.orchestra.run.smithi192.stdout: 788848 4 -rwx------ 1 ubuntu ubuntu 1859 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/Makefile 2023-06-23T18:52:37.724 INFO:teuthology.orchestra.run.smithi192.stdout: 788847 20 -rwx------ 1 ubuntu ubuntu 16962 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/COPYRIGHT 2023-06-23T18:52:37.724 INFO:teuthology.orchestra.run.smithi192.stdout: 788851 8 -rwx------ 1 ubuntu ubuntu 5282 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.1 2023-06-23T18:52:37.725 INFO:teuthology.orchestra.run.smithi192.stdout: 788853 4 drwx------ 2 ubuntu ubuntu 4096 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts 2023-06-23T18:52:37.725 INFO:teuthology.orchestra.run.smithi192.stdout: 788857 8 -rwx------ 1 ubuntu ubuntu 6264 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/tester.py 2023-06-23T18:52:37.725 INFO:teuthology.orchestra.run.smithi192.stdout: 788854 4 -rwx------ 1 ubuntu ubuntu 3462 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/env_to_db.tcsh 2023-06-23T18:52:37.725 INFO:teuthology.orchestra.run.smithi192.stdout: 788858 4 -rwx------ 1 ubuntu ubuntu 1255 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/WRAPPER_README 2023-06-23T18:52:37.725 INFO:teuthology.orchestra.run.smithi192.stdout: 788855 20 -rwx------ 1 ubuntu ubuntu 19576 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/mdtest_wrapper.py 2023-06-23T18:52:37.726 INFO:teuthology.orchestra.run.smithi192.stdout: 788856 4 -rwx------ 1 ubuntu ubuntu 1059 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/paramCatch.py 2023-06-23T18:52:37.726 INFO:teuthology.orchestra.run.smithi192.stdout: 788850 8 -rwx------ 1 ubuntu ubuntu 7123 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/RELEASE_LOG 2023-06-23T18:52:37.726 INFO:teuthology.orchestra.run.smithi192.stdout: 788852 96 -rw-r--r-- 1 ubuntu ubuntu 95873 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.c 2023-06-23T18:52:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-06-23T18:52:37.763 DEBUG:teuthology.nuke:shortname: smithi038 2023-06-23T18:52:37.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:52:37.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.543418', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPatyLVMjRsvi4ZOxM3cIu9GOmIfHEQpPSeyWPSio10NScSPoHcvBLS1RO/+tC7b1Di2ugncKIRfR7S9CzlZyIc='} 2023-06-23T18:52:37.793 DEBUG:teuthology.nuke:shortname: smithi081 2023-06-23T18:52:37.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:52:37.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.541155', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSHSUYPJIubE2l3G3kyqCtHh49GXNywM8jRQqFQqkyZyd0zVdnKRFrgE9K/q0igKMwJYWSov4Mw0b7clTdlyjQ='} 2023-06-23T18:52:37.829 DEBUG:teuthology.nuke:shortname: smithi118 2023-06-23T18:52:37.830 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:52:37.866 INFO:teuthology.orchestra.console:Power off smithi038 2023-06-23T18:52:37.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T18:52:37.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.542273', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLvoiJA5wTwxX7NHZ0F12F08/oGbPbEOm7EAOC6iyufkPO/FA9RVGUb/WluPfvCV+PZl07q0p41n4oVJC79LIdw='} 2023-06-23T18:52:37.883 DEBUG:teuthology.nuke:shortname: smithi164 2023-06-23T18:52:37.884 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:52:37.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:37.918 INFO:teuthology.orchestra.console:Power off smithi081 2023-06-23T18:52:37.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T18:52:37.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.537013', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNG9x/7esvpDkOFFay+qKOPnOe9ucG7mskpW06HS/N5Mo/KffmVHugNmDMYxP2mhvdM3rX6WNVDTpDupMnTr+qw='} 2023-06-23T18:52:37.936 DEBUG:teuthology.nuke:shortname: smithi192 2023-06-23T18:52:37.937 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:52:37.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:37.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:27:16.539364', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2KihXn35fSYKsF+1vyXgVxT/66bHjHwL5aChBkYAUeBX9A9ctnKD9ly24F073XN8AxUghHJ4ho2ezv6Bjz2iU='} 2023-06-23T18:52:37.980 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-23T18:52:37.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T18:52:38.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:38.034 INFO:teuthology.orchestra.console:Power off smithi164 2023-06-23T18:52:38.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T18:52:38.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:38.087 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-23T18:52:38.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T18:52:38.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:41.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:41.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:42.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:42.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:42.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.114 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:46.266 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-06-23T18:52:46.382 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-23T18:52:46.466 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-23T18:52:50.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:50.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T18:52:50.447 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2023-06-23T18:52:50.542 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-06-23T18:52:50.646 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} duration: 906.558965921402 failure_reason: 'Command failed on smithi164 with status 2: ''TESTDIR=/home/ubuntu/cephtest bash -s''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d378183392b44f99b58acff818a3b6f8 status: fail success: false 2023-06-23T18:52:50.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T18:52:50.732 INFO:teuthology.run:FAIL